2018-10-26 12:25:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:25:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:25:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:25:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:25:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:25:04 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:25:04 [DEBUG   ] Finished updating board flags in 2.048 seconds
2018-10-26 12:25:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 12:25:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 12:25:37 [DEBUG   ] Got command RPT from MCS: ref #277055
2018-10-26 12:25:37 [DEBUG   ] summary = ERROR
2018-10-26 12:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277055  13 58417 44737393 A  ERRORERROR'
2018-10-26 12:25:37 [DEBUG   ] Got command RPT from MCS: ref #277056
2018-10-26 12:25:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277056  84 58417 44737394 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:25:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 12:26:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:26:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:26:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:26:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:26:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:26:04 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:26:04 [DEBUG   ] Finished updating board flags in 2.053 seconds
2018-10-26 12:26:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 12:26:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 12:26:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 12:27:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:27:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:27:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:27:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:27:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:27:04 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:27:04 [DEBUG   ] Finished updating board flags in 1.941 seconds
2018-10-26 12:27:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 12:27:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 12:27:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 12:28:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:28:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:28:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:28:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:28:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:28:04 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:28:04 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-10-26 12:28:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 12:28:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 12:28:34 [DEBUG   ] Got command RPT from MCS: ref #277076
2018-10-26 12:28:34 [DEBUG   ] summary = ERROR
2018-10-26 12:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277076  13 58417 44914073 A  ERRORERROR'
2018-10-26 12:28:34 [DEBUG   ] Got command RPT from MCS: ref #277077
2018-10-26 12:28:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277077  84 58417 44914277 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:28:34 [DEBUG   ] Got command RPT from MCS: ref #277078
2018-10-26 12:28:34 [DEBUG   ] summary = ERROR
2018-10-26 12:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277078  13 58417 44914481 A  ERRORERROR'
2018-10-26 12:28:34 [DEBUG   ] Got command RPT from MCS: ref #277079
2018-10-26 12:28:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277079  84 58417 44914673 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:28:34 [DEBUG   ] Got command RPT from MCS: ref #277080
2018-10-26 12:28:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 12:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277080  12 58417 44914877 A  ERRORB™™š'
2018-10-26 12:28:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 12:29:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:29:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:29:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:29:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:29:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:29:04 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:29:04 [DEBUG   ] Finished updating board flags in 1.664 seconds
2018-10-26 12:29:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 12:29:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 12:29:53 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 12:30:03 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 12:30:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:30:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:30:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:30:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:30:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:30:04 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:30:04 [DEBUG   ] Finished updating board flags in 1.529 seconds
2018-10-26 12:30:13 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 12:30:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 12:30:37 [DEBUG   ] Got command RPT from MCS: ref #277085
2018-10-26 12:30:37 [DEBUG   ] summary = ERROR
2018-10-26 12:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277085  13 58417 45037393 A  ERRORERROR'
2018-10-26 12:30:37 [DEBUG   ] Got command RPT from MCS: ref #277086
2018-10-26 12:30:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277086  84 58417 45037394 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:30:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 12:31:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 12:31:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:31:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:31:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:31:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:31:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:31:04 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:31:04 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-26 12:31:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 12:31:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 12:31:53 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-26 12:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 12:32:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:32:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:32:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:32:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:32:04 [WARNING ] (13, 1, 'bot')
2018-10-26 12:32:04 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:32:04 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-10-26 12:32:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 12:32:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 12:32:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 12:33:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:33:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:33:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:33:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:33:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:33:05 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:33:05 [DEBUG   ] Finished updating board flags in 2.208 seconds
2018-10-26 12:33:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 12:33:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 12:33:34 [DEBUG   ] Got command RPT from MCS: ref #277108
2018-10-26 12:33:34 [DEBUG   ] summary = ERROR
2018-10-26 12:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277108  13 58417 45214157 A  ERRORERROR'
2018-10-26 12:33:34 [DEBUG   ] Got command RPT from MCS: ref #277109
2018-10-26 12:33:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277109  84 58417 45214361 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:33:34 [DEBUG   ] Got command RPT from MCS: ref #277110
2018-10-26 12:33:34 [DEBUG   ] summary = ERROR
2018-10-26 12:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277110  13 58417 45214565 A  ERRORERROR'
2018-10-26 12:33:34 [DEBUG   ] Got command RPT from MCS: ref #277112
2018-10-26 12:33:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277112  84 58417 45214757 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:33:34 [DEBUG   ] Got command RPT from MCS: ref #277113
2018-10-26 12:33:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 12:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277113  12 58417 45214961 A  ERRORB˜™š'
2018-10-26 12:33:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 12:34:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:34:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:34:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:34:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:34:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:34:05 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:34:05 [DEBUG   ] Finished updating board flags in 2.185 seconds
2018-10-26 12:34:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 12:34:33 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-26 12:34:54 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-26 12:35:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:35:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 12:35:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:35:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:35:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:35:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:35:05 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:35:05 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-10-26 12:35:14 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 12:35:34 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 12:35:37 [DEBUG   ] Got command RPT from MCS: ref #277122
2018-10-26 12:35:37 [DEBUG   ] summary = ERROR
2018-10-26 12:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277122  13 58417 45337401 A  ERRORERROR'
2018-10-26 12:35:37 [DEBUG   ] Got command RPT from MCS: ref #277123
2018-10-26 12:35:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277123  84 58417 45337402 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:35:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 12:36:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:36:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:36:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:36:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:36:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:36:05 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:36:05 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-10-26 12:36:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 12:36:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 12:36:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 12:37:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 12:37:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:37:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 12:37:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:37:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:37:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:37:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:37:05 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:37:05 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-10-26 12:37:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 12:37:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 12:37:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 12:38:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:38:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:38:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:38:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:38:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:38:05 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:38:05 [DEBUG   ] Finished updating board flags in 1.840 seconds
2018-10-26 12:38:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 12:38:34 [DEBUG   ] Got command RPT from MCS: ref #277143
2018-10-26 12:38:34 [DEBUG   ] summary = ERROR
2018-10-26 12:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277143  13 58417 45514241 A  ERRORERROR'
2018-10-26 12:38:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 12:38:34 [DEBUG   ] Got command RPT from MCS: ref #277144
2018-10-26 12:38:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277144  84 58417 45514445 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:38:34 [DEBUG   ] Got command RPT from MCS: ref #277145
2018-10-26 12:38:34 [DEBUG   ] summary = ERROR
2018-10-26 12:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277145  13 58417 45514649 A  ERRORERROR'
2018-10-26 12:38:34 [DEBUG   ] Got command RPT from MCS: ref #277146
2018-10-26 12:38:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277146  84 58417 45514853 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:38:35 [DEBUG   ] Got command RPT from MCS: ref #277147
2018-10-26 12:38:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 12:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277147  12 58417 45515045 A  ERRORB™™š'
2018-10-26 12:38:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 12:39:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:39:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 12:39:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:39:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:39:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:39:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:39:05 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:39:05 [DEBUG   ] Finished updating board flags in 1.766 seconds
2018-10-26 12:39:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 12:39:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 12:39:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 12:40:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 12:40:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:40:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 12:40:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:40:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:40:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:40:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:40:05 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:40:05 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-10-26 12:40:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 12:40:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 12:40:37 [DEBUG   ] Got command RPT from MCS: ref #277148
2018-10-26 12:40:37 [DEBUG   ] summary = ERROR
2018-10-26 12:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277148  13 58417 45637393 A  ERRORERROR'
2018-10-26 12:40:37 [DEBUG   ] Got command RPT from MCS: ref #277149
2018-10-26 12:40:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277149  84 58417 45637394 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:40:55 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 12:41:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:41:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:41:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:41:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:41:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:41:05 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:41:05 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-10-26 12:41:15 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 12:41:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 12:41:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 12:42:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:42:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:42:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:42:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:42:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:42:05 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:42:05 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-10-26 12:42:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 12:42:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 12:42:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 12:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 12:43:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:43:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 12:43:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:43:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:43:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:43:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:43:05 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:43:05 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-26 12:43:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 12:43:34 [DEBUG   ] Got command RPT from MCS: ref #277171
2018-10-26 12:43:34 [DEBUG   ] summary = ERROR
2018-10-26 12:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277171  13 58417 45814333 A  ERRORERROR'
2018-10-26 12:43:34 [DEBUG   ] Got command RPT from MCS: ref #277172
2018-10-26 12:43:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277172  84 58417 45814538 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:43:34 [DEBUG   ] Got command RPT from MCS: ref #277173
2018-10-26 12:43:34 [DEBUG   ] summary = ERROR
2018-10-26 12:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277173  13 58417 45814729 A  ERRORERROR'
2018-10-26 12:43:34 [DEBUG   ] Got command RPT from MCS: ref #277175
2018-10-26 12:43:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277175  84 58417 45814933 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:43:35 [DEBUG   ] Got command RPT from MCS: ref #277176
2018-10-26 12:43:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 12:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277176  12 58417 45815137 A  ERRORB™™š'
2018-10-26 12:43:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 12:43:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 12:44:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:44:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:44:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:44:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:44:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:44:05 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:44:05 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-10-26 12:44:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 12:44:35 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 12:44:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 12:45:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 12:45:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:45:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:45:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:45:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:45:05 [WARNING ] (13, 1, 'bot')
2018-10-26 12:45:05 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:45:05 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-10-26 12:45:16 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-10-26 12:45:36 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 12:45:37 [DEBUG   ] Got command RPT from MCS: ref #277185
2018-10-26 12:45:37 [DEBUG   ] summary = ERROR
2018-10-26 12:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277185  13 58417 45937397 A  ERRORERROR'
2018-10-26 12:45:37 [DEBUG   ] Got command RPT from MCS: ref #277186
2018-10-26 12:45:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277186  84 58417 45937398 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:45:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 12:46:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:46:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:46:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:46:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:46:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:46:06 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:46:06 [DEBUG   ] Finished updating board flags in 2.050 seconds
2018-10-26 12:46:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 12:46:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 12:46:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 12:47:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 12:47:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:47:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:47:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:47:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:47:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:47:06 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:47:06 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-10-26 12:47:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 12:47:36 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-26 12:47:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 12:48:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:48:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 12:48:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:48:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:48:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:48:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:48:06 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:48:06 [DEBUG   ] Finished updating board flags in 2.037 seconds
2018-10-26 12:48:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 12:48:34 [DEBUG   ] Got command RPT from MCS: ref #277206
2018-10-26 12:48:34 [DEBUG   ] summary = ERROR
2018-10-26 12:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277206  13 58417 46114421 A  ERRORERROR'
2018-10-26 12:48:34 [DEBUG   ] Got command RPT from MCS: ref #277207
2018-10-26 12:48:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277207  84 58417 46114625 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:48:34 [DEBUG   ] Got command RPT from MCS: ref #277208
2018-10-26 12:48:34 [DEBUG   ] summary = ERROR
2018-10-26 12:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277208  13 58417 46114817 A  ERRORERROR'
2018-10-26 12:48:35 [DEBUG   ] Got command RPT from MCS: ref #277209
2018-10-26 12:48:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277209  84 58417 46115021 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:48:35 [DEBUG   ] Got command RPT from MCS: ref #277210
2018-10-26 12:48:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 12:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277210  12 58417 46115225 A  ERRORB™™š'
2018-10-26 12:48:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 12:48:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 12:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 12:49:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:49:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:49:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:49:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:49:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:49:06 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:49:06 [DEBUG   ] Finished updating board flags in 1.952 seconds
2018-10-26 12:49:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 12:49:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 12:49:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 12:50:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:50:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:50:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:50:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:50:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:50:06 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:50:06 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-10-26 12:50:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 12:50:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 12:50:37 [DEBUG   ] Got command RPT from MCS: ref #277215
2018-10-26 12:50:37 [DEBUG   ] summary = ERROR
2018-10-26 12:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277215  13 58417 46237401 A  ERRORERROR'
2018-10-26 12:50:37 [DEBUG   ] Got command RPT from MCS: ref #277216
2018-10-26 12:50:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277216  84 58417 46237402 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:50:57 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 12:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 12:51:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:51:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 12:51:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:51:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:51:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:51:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:51:06 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:51:06 [DEBUG   ] Finished updating board flags in 1.800 seconds
2018-10-26 12:51:17 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 12:51:37 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 12:51:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 12:52:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 12:52:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:52:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 12:52:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:52:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:52:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:52:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:52:06 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:52:06 [DEBUG   ] Finished updating board flags in 1.601 seconds
2018-10-26 12:52:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 12:52:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 12:52:57 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-26 12:53:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:53:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:53:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:53:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:53:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:53:06 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:53:06 [DEBUG   ] Finished updating board flags in 1.645 seconds
2018-10-26 12:53:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 12:53:34 [DEBUG   ] Got command RPT from MCS: ref #277238
2018-10-26 12:53:34 [DEBUG   ] summary = ERROR
2018-10-26 12:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277238  13 58417 46414501 A  ERRORERROR'
2018-10-26 12:53:34 [DEBUG   ] Got command RPT from MCS: ref #277239
2018-10-26 12:53:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277239  84 58417 46414705 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:53:34 [DEBUG   ] Got command RPT from MCS: ref #277240
2018-10-26 12:53:34 [DEBUG   ] summary = ERROR
2018-10-26 12:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277240  13 58417 46414909 A  ERRORERROR'
2018-10-26 12:53:35 [DEBUG   ] Got command RPT from MCS: ref #277242
2018-10-26 12:53:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277242  84 58417 46415101 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:53:35 [DEBUG   ] Got command RPT from MCS: ref #277243
2018-10-26 12:53:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 12:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277243  12 58417 46415305 A  ERRORB™™š'
2018-10-26 12:53:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 12:53:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 12:54:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:54:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:54:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:54:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:54:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:54:06 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:54:06 [DEBUG   ] Finished updating board flags in 1.551 seconds
2018-10-26 12:54:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 12:54:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 12:54:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 12:55:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:55:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:55:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:55:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:55:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:55:06 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:55:06 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-26 12:55:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 12:55:37 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 12:55:37 [DEBUG   ] Got command RPT from MCS: ref #277248
2018-10-26 12:55:37 [DEBUG   ] summary = ERROR
2018-10-26 12:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277248  13 58417 46537405 A  ERRORERROR'
2018-10-26 12:55:37 [DEBUG   ] Got command RPT from MCS: ref #277249
2018-10-26 12:55:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277249  84 58417 46537406 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:55:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 12:56:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:56:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:56:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:56:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:56:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:56:06 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:56:06 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-10-26 12:56:18 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-26 12:56:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 12:56:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 12:57:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:57:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:57:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:57:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:57:06 [WARNING ] (13, 1, 'bot')
2018-10-26 12:57:06 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:57:06 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-10-26 12:57:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 12:57:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 12:57:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 12:58:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:58:07 [WARNING ] (13, 1, 'bot')
2018-10-26 12:58:07 [WARNING ] (13, 1, 'bot')
2018-10-26 12:58:07 [WARNING ] (13, 1, 'bot')
2018-10-26 12:58:07 [WARNING ] (13, 1, 'bot')
2018-10-26 12:58:07 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:58:07 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-10-26 12:58:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 12:58:34 [DEBUG   ] Got command RPT from MCS: ref #277269
2018-10-26 12:58:34 [DEBUG   ] summary = ERROR
2018-10-26 12:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277269  13 58417 46714589 A  ERRORERROR'
2018-10-26 12:58:34 [DEBUG   ] Got command RPT from MCS: ref #277270
2018-10-26 12:58:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277270  84 58417 46714793 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:58:34 [DEBUG   ] Got command RPT from MCS: ref #277271
2018-10-26 12:58:34 [DEBUG   ] summary = ERROR
2018-10-26 12:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277271  13 58417 46714985 A  ERRORERROR'
2018-10-26 12:58:35 [DEBUG   ] Got command RPT from MCS: ref #277272
2018-10-26 12:58:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 12:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277272  84 58417 46715189 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 12:58:35 [DEBUG   ] Got command RPT from MCS: ref #277273
2018-10-26 12:58:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 12:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277273  12 58417 46715393 A  ERRORB˜™š'
2018-10-26 12:58:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 12:58:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 12:59:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 12:59:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 12:59:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 12:59:07 [WARNING ] (13, 1, 'bot')
2018-10-26 12:59:07 [WARNING ] (13, 1, 'bot')
2018-10-26 12:59:07 [WARNING ] (13, 1, 'bot')
2018-10-26 12:59:07 [WARNING ] (13, 1, 'bot')
2018-10-26 12:59:07 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 12:59:07 [DEBUG   ] Finished updating board flags in 1.997 seconds
2018-10-26 12:59:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 12:59:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 12:59:58 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-26 13:00:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:00:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:00:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:00:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:00:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:00:07 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:00:07 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-26 13:00:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 13:00:37 [DEBUG   ] Got command RPT from MCS: ref #277278
2018-10-26 13:00:37 [DEBUG   ] summary = ERROR
2018-10-26 13:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277278  13 58417 46837405 A  ERRORERROR'
2018-10-26 13:00:37 [DEBUG   ] Got command RPT from MCS: ref #277279
2018-10-26 13:00:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277279  84 58417 46837406 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:00:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 13:00:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 13:01:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:01:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:01:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:01:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:01:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:01:07 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:01:07 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-10-26 13:01:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 13:01:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 13:01:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 13:02:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:02:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 13:02:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:02:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:02:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:02:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:02:07 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:02:07 [DEBUG   ] Finished updating board flags in 1.629 seconds
2018-10-26 13:02:19 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 13:02:38 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-26 13:02:58 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-26 13:03:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:03:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:03:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:03:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:03:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:03:07 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:03:07 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-10-26 13:03:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 13:03:34 [DEBUG   ] Got command RPT from MCS: ref #277301
2018-10-26 13:03:34 [DEBUG   ] summary = ERROR
2018-10-26 13:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277301  13 58417 47014677 A  ERRORERROR'
2018-10-26 13:03:34 [DEBUG   ] Got command RPT from MCS: ref #277302
2018-10-26 13:03:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277302  84 58417 47014869 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:03:35 [DEBUG   ] Got command RPT from MCS: ref #277303
2018-10-26 13:03:35 [DEBUG   ] summary = ERROR
2018-10-26 13:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277303  13 58417 47015073 A  ERRORERROR'
2018-10-26 13:03:35 [DEBUG   ] Got command RPT from MCS: ref #277305
2018-10-26 13:03:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277305  84 58417 47015277 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:03:35 [DEBUG   ] Got command RPT from MCS: ref #277306
2018-10-26 13:03:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 13:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277306  12 58417 47015481 A  ERRORB˜™š'
2018-10-26 13:03:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 13:03:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 13:04:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:04:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:04:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:04:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:04:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:04:07 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:04:07 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-26 13:04:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 13:04:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 13:04:59 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-26 13:05:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:05:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:05:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:05:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:05:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:05:07 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:05:07 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-10-26 13:05:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 13:05:37 [DEBUG   ] Got command RPT from MCS: ref #277315
2018-10-26 13:05:37 [DEBUG   ] summary = ERROR
2018-10-26 13:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277315  13 58417 47137405 A  ERRORERROR'
2018-10-26 13:05:37 [DEBUG   ] Got command RPT from MCS: ref #277316
2018-10-26 13:05:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277316  84 58417 47137406 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:05:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 13:05:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 13:06:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:06:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:06:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:06:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:06:07 [WARNING ] (13, 1, 'bot')
2018-10-26 13:06:07 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:06:07 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-10-26 13:06:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 13:06:39 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 13:06:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 13:07:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 13:07:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:07:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:07:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:07:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:07:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:07:08 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:07:08 [DEBUG   ] Finished updating board flags in 2.031 seconds
2018-10-26 13:07:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 13:07:39 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-26 13:07:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 13:08:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:08:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:08:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:08:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:08:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:08:08 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:08:08 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-10-26 13:08:20 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 13:08:34 [DEBUG   ] Got command RPT from MCS: ref #277336
2018-10-26 13:08:34 [DEBUG   ] summary = ERROR
2018-10-26 13:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277336  13 58417 47314761 A  ERRORERROR'
2018-10-26 13:08:34 [DEBUG   ] Got command RPT from MCS: ref #277337
2018-10-26 13:08:34 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277337  84 58417 47314965 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:08:35 [DEBUG   ] Got command RPT from MCS: ref #277338
2018-10-26 13:08:35 [DEBUG   ] summary = ERROR
2018-10-26 13:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277338  13 58417 47315157 A  ERRORERROR'
2018-10-26 13:08:35 [DEBUG   ] Got command RPT from MCS: ref #277339
2018-10-26 13:08:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277339  84 58417 47315361 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:08:35 [DEBUG   ] Got command RPT from MCS: ref #277340
2018-10-26 13:08:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 13:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277340  12 58417 47315565 A  ERRORB˜™š'
2018-10-26 13:08:40 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 13:09:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 13:09:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:09:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:09:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:09:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:09:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:09:08 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:09:08 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-10-26 13:09:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 13:09:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 13:10:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 13:10:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:10:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:10:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:10:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:10:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:10:08 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:10:08 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-10-26 13:10:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 13:10:37 [DEBUG   ] Got command RPT from MCS: ref #277341
2018-10-26 13:10:37 [DEBUG   ] summary = ERROR
2018-10-26 13:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277341  13 58417 47437409 A  ERRORERROR'
2018-10-26 13:10:37 [DEBUG   ] Got command RPT from MCS: ref #277342
2018-10-26 13:10:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277342  84 58417 47437410 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:10:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 13:11:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 13:11:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:11:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 13:11:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:11:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:11:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:11:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:11:08 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:11:08 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-26 13:11:20 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-26 13:11:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 13:12:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 13:12:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:12:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 13:12:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:12:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:12:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:12:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:12:08 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:12:08 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-10-26 13:12:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 13:12:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 13:13:00 [DEBUG   ] Finished updating ant stats in 0.543 seconds
2018-10-26 13:13:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:13:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:13:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:13:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:13:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:13:08 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:13:08 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-10-26 13:13:21 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-10-26 13:13:34 [DEBUG   ] Got command RPT from MCS: ref #277364
2018-10-26 13:13:34 [DEBUG   ] summary = ERROR
2018-10-26 13:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277364  13 58417 47614841 A  ERRORERROR'
2018-10-26 13:13:35 [DEBUG   ] Got command RPT from MCS: ref #277365
2018-10-26 13:13:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277365  84 58417 47615045 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:13:35 [DEBUG   ] Got command RPT from MCS: ref #277366
2018-10-26 13:13:35 [DEBUG   ] summary = ERROR
2018-10-26 13:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277366  13 58417 47615249 A  ERRORERROR'
2018-10-26 13:13:35 [DEBUG   ] Got command RPT from MCS: ref #277368
2018-10-26 13:13:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277368  84 58417 47615441 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:13:35 [DEBUG   ] Got command RPT from MCS: ref #277370
2018-10-26 13:13:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 13:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277370  12 58417 47615645 A  ERRORB˜™š'
2018-10-26 13:13:41 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-26 13:14:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 13:14:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:14:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:14:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:14:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:14:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:14:08 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:14:08 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-10-26 13:14:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 13:14:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 13:15:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 13:15:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:15:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:15:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:15:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:15:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:15:08 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:15:08 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-26 13:15:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 13:15:37 [DEBUG   ] Got command RPT from MCS: ref #277378
2018-10-26 13:15:37 [DEBUG   ] summary = ERROR
2018-10-26 13:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277378  13 58417 47737405 A  ERRORERROR'
2018-10-26 13:15:37 [DEBUG   ] Got command RPT from MCS: ref #277379
2018-10-26 13:15:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277379  84 58417 47737406 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:15:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 13:16:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-26 13:16:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:16:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 13:16:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:16:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:16:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:16:08 [WARNING ] (13, 1, 'bot')
2018-10-26 13:16:08 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:16:08 [DEBUG   ] Finished updating board flags in 1.343 seconds
2018-10-26 13:16:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 13:16:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 13:17:01 [DEBUG   ] Finished updating ant stats in 0.877 seconds
2018-10-26 13:17:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:17:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:17:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:17:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:17:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:17:09 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:17:09 [DEBUG   ] Finished updating board flags in 2.063 seconds
2018-10-26 13:17:21 [DEBUG   ] Finished updating ant stats in 0.727 seconds
2018-10-26 13:17:41 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-26 13:18:01 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 13:18:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:18:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 13:18:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:18:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:18:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:18:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:18:09 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:18:09 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-10-26 13:18:22 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-26 13:18:34 [DEBUG   ] Got command RPT from MCS: ref #277399
2018-10-26 13:18:35 [DEBUG   ] summary = ERROR
2018-10-26 13:18:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277399  13 58417 47915546 A  ERRORERROR'
2018-10-26 13:18:35 [DEBUG   ] Got command RPT from MCS: ref #277400
2018-10-26 13:18:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:18:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277400  84 58417 47915737 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:18:35 [DEBUG   ] Got command RPT from MCS: ref #277401
2018-10-26 13:18:35 [DEBUG   ] summary = ERROR
2018-10-26 13:18:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277401  13 58417 47915941 A  ERRORERROR'
2018-10-26 13:18:36 [DEBUG   ] Got command RPT from MCS: ref #277402
2018-10-26 13:18:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277402  84 58417 47916134 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:18:36 [DEBUG   ] Got command RPT from MCS: ref #277403
2018-10-26 13:18:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 13:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277403  12 58417 47916337 A  ERRORB™™š'
2018-10-26 13:18:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 13:19:02 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-26 13:19:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:19:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:19:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:19:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:19:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:19:09 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:19:09 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-10-26 13:19:22 [DEBUG   ] Finished updating ant stats in 1.211 seconds
2018-10-26 13:19:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 13:20:02 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 13:20:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 13:20:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:20:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:20:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:20:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:20:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:20:09 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:20:09 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-10-26 13:20:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 13:20:37 [DEBUG   ] Got command RPT from MCS: ref #277408
2018-10-26 13:20:37 [DEBUG   ] summary = ERROR
2018-10-26 13:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277408  13 58417 48037409 A  ERRORERROR'
2018-10-26 13:20:37 [DEBUG   ] Got command RPT from MCS: ref #277409
2018-10-26 13:20:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277409  84 58417 48037410 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:20:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 13:21:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 13:21:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:21:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:21:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:21:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:21:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:21:09 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:21:09 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-10-26 13:21:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 13:21:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 13:22:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 13:22:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:22:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 13:22:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:22:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:22:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:22:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:22:09 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:22:09 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-26 13:22:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 13:22:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 13:23:03 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 13:23:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:23:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:23:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:23:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:23:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:23:09 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:23:09 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-10-26 13:23:23 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 13:23:35 [DEBUG   ] Got command RPT from MCS: ref #277431
2018-10-26 13:23:35 [DEBUG   ] summary = ERROR
2018-10-26 13:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277431  13 58417 48215021 A  ERRORERROR'
2018-10-26 13:23:35 [DEBUG   ] Got command RPT from MCS: ref #277432
2018-10-26 13:23:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277432  84 58417 48215213 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:23:35 [DEBUG   ] Got command RPT from MCS: ref #277433
2018-10-26 13:23:35 [DEBUG   ] summary = ERROR
2018-10-26 13:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277433  13 58417 48215417 A  ERRORERROR'
2018-10-26 13:23:35 [DEBUG   ] Got command RPT from MCS: ref #277435
2018-10-26 13:23:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277435  84 58417 48215621 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:23:35 [DEBUG   ] Got command RPT from MCS: ref #277437
2018-10-26 13:23:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 13:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277437  12 58417 48215825 A  ERRORB˜™š'
2018-10-26 13:23:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 13:24:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 13:24:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:24:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 13:24:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:24:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:24:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:24:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:24:09 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:24:09 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-10-26 13:24:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 13:24:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 13:25:03 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 13:25:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:25:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:25:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:25:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:25:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:25:09 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:25:09 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-10-26 13:25:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 13:25:37 [DEBUG   ] Got command RPT from MCS: ref #277441
2018-10-26 13:25:37 [DEBUG   ] summary = ERROR
2018-10-26 13:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277441  13 58417 48337409 A  ERRORERROR'
2018-10-26 13:25:37 [DEBUG   ] Got command RPT from MCS: ref #277442
2018-10-26 13:25:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277442  84 58417 48337410 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:25:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 13:26:03 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-26 13:26:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:26:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 13:26:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:26:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:26:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:26:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:26:09 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:26:09 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-26 13:26:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 13:26:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 13:27:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 13:27:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:27:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:27:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:27:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:27:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:27:09 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:27:09 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-10-26 13:27:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 13:27:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 13:28:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 13:28:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:28:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:28:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:28:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:28:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:28:09 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:28:09 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-26 13:28:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 13:28:35 [DEBUG   ] Got command RPT from MCS: ref #277462
2018-10-26 13:28:35 [DEBUG   ] summary = ERROR
2018-10-26 13:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277462  13 58417 48515259 A  ERRORERROR'
2018-10-26 13:28:35 [DEBUG   ] Got command RPT from MCS: ref #277463
2018-10-26 13:28:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277463  84 58417 48515305 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:28:35 [DEBUG   ] Got command RPT from MCS: ref #277464
2018-10-26 13:28:35 [DEBUG   ] summary = ERROR
2018-10-26 13:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277464  13 58417 48515497 A  ERRORERROR'
2018-10-26 13:28:35 [DEBUG   ] Got command RPT from MCS: ref #277465
2018-10-26 13:28:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277465  84 58417 48515701 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:28:35 [DEBUG   ] Got command RPT from MCS: ref #277466
2018-10-26 13:28:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 13:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277466  12 58417 48515905 A  ERRORB˜™š'
2018-10-26 13:28:43 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-26 13:29:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 13:29:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:29:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-26 13:29:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:29:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:29:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:29:09 [WARNING ] (13, 1, 'bot')
2018-10-26 13:29:09 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:29:09 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-26 13:29:24 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 13:29:44 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 13:30:00 [DEBUG   ] Got command TBN from MCS: ref #277471
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-26 13:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   277471   8 58417 48600454 A  ERROR'
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540560601']
2018-10-26 13:30:00 [DEBUG   ] spawn_process: at 2018-10-26 13:30:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540560601']
2018-10-26 13:30:00 [INFO    ] Finished spawning TBN in 0.050 s
2018-10-26 13:30:04 [DEBUG   ] Finished updating ant stats in 1.133 seconds
2018-10-26 13:30:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 13:30:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:30:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:30:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:30:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:30:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:30:10 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:30:10 [DEBUG   ] Finished updating board flags in 2.226 seconds
2018-10-26 13:30:24 [DEBUG   ] Finished updating ant stats in 1.068 seconds
2018-10-26 13:30:37 [DEBUG   ] Got command RPT from MCS: ref #277472
2018-10-26 13:30:37 [DEBUG   ] summary = ERROR
2018-10-26 13:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277472  13 58417 48637409 A  ERRORERROR'
2018-10-26 13:30:37 [DEBUG   ] Got command RPT from MCS: ref #277473
2018-10-26 13:30:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277473  84 58417 48637410 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:30:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 13:31:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 13:31:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 13:31:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:31:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 13:31:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:31:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:31:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:31:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:31:10 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:31:10 [DEBUG   ] Finished updating board flags in 2.170 seconds
2018-10-26 13:31:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 13:31:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 13:32:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 13:32:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:32:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:32:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:32:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:32:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:32:10 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:32:10 [DEBUG   ] Finished updating board flags in 2.022 seconds
2018-10-26 13:32:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 13:32:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 13:33:04 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-26 13:33:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:33:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:33:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:33:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:33:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:33:10 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:33:10 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-10-26 13:33:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 13:33:35 [DEBUG   ] Got command RPT from MCS: ref #277495
2018-10-26 13:33:35 [DEBUG   ] summary = ERROR
2018-10-26 13:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277495  13 58417 48815185 A  ERRORERROR'
2018-10-26 13:33:35 [DEBUG   ] Got command RPT from MCS: ref #277496
2018-10-26 13:33:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277496  84 58417 48815390 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:33:35 [DEBUG   ] Got command RPT from MCS: ref #277497
2018-10-26 13:33:35 [DEBUG   ] summary = ERROR
2018-10-26 13:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277497  13 58417 48815593 A  ERRORERROR'
2018-10-26 13:33:35 [DEBUG   ] Got command RPT from MCS: ref #277499
2018-10-26 13:33:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277499  84 58417 48815785 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:33:35 [DEBUG   ] Got command RPT from MCS: ref #277501
2018-10-26 13:33:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 13:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277501  12 58417 48815989 A  ERRORB˜™š'
2018-10-26 13:33:45 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 13:34:05 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 13:34:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 13:34:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:34:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:34:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:34:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:34:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:34:10 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:34:10 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-26 13:34:11 [DEBUG   ] Got command TBW from MCS: ref #277506
2018-10-26 13:34:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-10-26 13:34:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   277506   8 58417 48851514 A  ERROR'
2018-10-26 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-10-26 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-10-26 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-10-26 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-10-26 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-10-26 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-10-26 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-10-26 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-10-26 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-10-26 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-10-26 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-10-26 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-10-26 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-10-26 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-10-26 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-10-26 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-10-26 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-10-26 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-10-26 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-10-26 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-10-26 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-10-26 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-10-26 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-10-26 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-10-26 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-10-26 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-10-26 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-10-26 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-10-26 13:34:14 [DEBUG   ] spawn_process: at 2018-10-26 13:34:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-10-26 13:34:14 [DEBUG   ] spawn_process: at 2018-10-26 13:34:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-10-26 13:34:14 [DEBUG   ] spawn_process: at 2018-10-26 13:34:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-10-26 13:34:15 [DEBUG   ] spawn_process: at 2018-10-26 13:34:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-10-26 13:34:15 [INFO    ] Finished spawning TBW
2018-10-26 13:35:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:35:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:35:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:35:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:35:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:35:10 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:35:10 [DEBUG   ] Finished updating board flags in 1.745 seconds
2018-10-26 13:35:37 [DEBUG   ] Got command RPT from MCS: ref #277514
2018-10-26 13:35:37 [DEBUG   ] summary = ERROR
2018-10-26 13:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277514  13 58417 48937417 A  ERRORERROR'
2018-10-26 13:35:37 [DEBUG   ] Got command RPT from MCS: ref #277515
2018-10-26 13:35:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277515  84 58417 48937418 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:36:03 [INFO    ] __waitForTBW - TBW finished in 108.830 s
2018-10-26 13:36:04 [DEBUG   ] Finished updating ant stats in 0.423 seconds
2018-10-26 13:36:04 [INFO    ] Started antennas statistics background thread
2018-10-26 13:36:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540560966']
2018-10-26 13:36:04 [DEBUG   ] spawn_process: at 2018-10-26 13:36:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540560966']
2018-10-26 13:36:04 [INFO    ] Finished spawning TBN in 0.051 s
2018-10-26 13:36:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:36:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:36:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:36:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:36:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:36:10 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:36:10 [DEBUG   ] Finished updating board flags in 1.462 seconds
2018-10-26 13:36:24 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2018-10-26 13:36:44 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-26 13:37:04 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-26 13:37:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 13:37:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:37:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:37:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:37:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:37:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:37:10 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:37:10 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-26 13:37:25 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-26 13:37:45 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 13:38:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 13:38:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:38:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:38:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:38:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:38:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:38:10 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:38:10 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-10-26 13:38:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 13:38:35 [DEBUG   ] Got command RPT from MCS: ref #277539
2018-10-26 13:38:35 [DEBUG   ] summary = ERROR
2018-10-26 13:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277539  13 58417 49115269 A  ERRORERROR'
2018-10-26 13:38:35 [DEBUG   ] Got command RPT from MCS: ref #277540
2018-10-26 13:38:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277540  84 58417 49115473 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:38:35 [DEBUG   ] Got command RPT from MCS: ref #277541
2018-10-26 13:38:35 [DEBUG   ] summary = ERROR
2018-10-26 13:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277541  13 58417 49115677 A  ERRORERROR'
2018-10-26 13:38:35 [DEBUG   ] Got command RPT from MCS: ref #277542
2018-10-26 13:38:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277542  84 58417 49115870 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:38:36 [DEBUG   ] Got command RPT from MCS: ref #277543
2018-10-26 13:38:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 13:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277543  12 58417 49116077 A  ERRORB˜™š'
2018-10-26 13:38:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 13:39:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 13:39:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:39:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:39:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:39:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:39:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:39:10 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:39:10 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-26 13:39:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 13:39:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 13:40:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 13:40:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:40:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 13:40:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:40:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:40:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:40:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:40:10 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:40:10 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-26 13:40:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 13:40:37 [DEBUG   ] Got command RPT from MCS: ref #277544
2018-10-26 13:40:37 [DEBUG   ] summary = ERROR
2018-10-26 13:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277544  13 58417 49237417 A  ERRORERROR'
2018-10-26 13:40:37 [DEBUG   ] Got command RPT from MCS: ref #277545
2018-10-26 13:40:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277545  84 58417 49237418 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:40:45 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-26 13:41:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 13:41:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:41:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:41:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:41:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:41:10 [WARNING ] (13, 1, 'bot')
2018-10-26 13:41:10 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:41:10 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-10-26 13:41:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 13:41:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 13:42:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 13:42:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:42:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:42:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:42:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:42:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:42:11 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:42:11 [DEBUG   ] Finished updating board flags in 2.175 seconds
2018-10-26 13:42:25 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-10-26 13:42:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 13:43:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 13:43:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:43:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:43:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:43:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:43:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:43:11 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:43:11 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-10-26 13:43:26 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-26 13:43:35 [DEBUG   ] Got command RPT from MCS: ref #277567
2018-10-26 13:43:35 [DEBUG   ] summary = ERROR
2018-10-26 13:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277567  13 58417 49415357 A  ERRORERROR'
2018-10-26 13:43:35 [DEBUG   ] Got command RPT from MCS: ref #277568
2018-10-26 13:43:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277568  84 58417 49415561 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:43:35 [DEBUG   ] Got command RPT from MCS: ref #277569
2018-10-26 13:43:35 [DEBUG   ] summary = ERROR
2018-10-26 13:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277569  13 58417 49415753 A  ERRORERROR'
2018-10-26 13:43:35 [DEBUG   ] Got command RPT from MCS: ref #277571
2018-10-26 13:43:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277571  84 58417 49415957 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:43:36 [DEBUG   ] Got command RPT from MCS: ref #277572
2018-10-26 13:43:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 13:43:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277572  12 58417 49416161 A  ERRORB˜™š'
2018-10-26 13:43:46 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 13:44:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 13:44:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:44:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 13:44:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:44:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:44:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:44:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:44:11 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:44:11 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-10-26 13:44:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 13:44:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 13:45:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 13:45:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:45:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 13:45:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:45:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:45:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:45:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:45:11 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:45:11 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-10-26 13:45:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 13:45:37 [DEBUG   ] Got command RPT from MCS: ref #277581
2018-10-26 13:45:37 [DEBUG   ] summary = ERROR
2018-10-26 13:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277581  13 58417 49537413 A  ERRORERROR'
2018-10-26 13:45:37 [DEBUG   ] Got command RPT from MCS: ref #277582
2018-10-26 13:45:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277582  84 58417 49537414 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:45:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 13:46:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 13:46:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:46:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 13:46:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:46:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:46:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:46:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:46:11 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:46:11 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-10-26 13:46:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 13:46:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 13:47:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 13:47:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:47:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:47:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:47:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:47:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:47:11 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:47:11 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-26 13:47:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 13:47:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 13:48:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 13:48:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:48:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:48:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:48:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:48:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:48:11 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:48:11 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-10-26 13:48:26 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-26 13:48:35 [DEBUG   ] Got command RPT from MCS: ref #277602
2018-10-26 13:48:35 [DEBUG   ] summary = ERROR
2018-10-26 13:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277602  13 58417 49715437 A  ERRORERROR'
2018-10-26 13:48:35 [DEBUG   ] Got command RPT from MCS: ref #277603
2018-10-26 13:48:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277603  84 58417 49715641 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:48:35 [DEBUG   ] Got command RPT from MCS: ref #277604
2018-10-26 13:48:35 [DEBUG   ] summary = ERROR
2018-10-26 13:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277604  13 58417 49715845 A  ERRORERROR'
2018-10-26 13:48:36 [DEBUG   ] Got command RPT from MCS: ref #277605
2018-10-26 13:48:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277605  84 58417 49716049 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:48:36 [DEBUG   ] Got command RPT from MCS: ref #277606
2018-10-26 13:48:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 13:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277606  12 58417 49716242 A  ERRORB™™š'
2018-10-26 13:48:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 13:49:07 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 13:49:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:49:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:49:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:49:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:49:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:49:11 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:49:11 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-10-26 13:49:26 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-26 13:49:47 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-26 13:50:07 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 13:50:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:50:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 13:50:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:50:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:50:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:50:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:50:11 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:50:11 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-10-26 13:50:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 13:50:37 [DEBUG   ] Got command RPT from MCS: ref #277616
2018-10-26 13:50:37 [DEBUG   ] summary = ERROR
2018-10-26 13:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277616  13 58417 49837409 A  ERRORERROR'
2018-10-26 13:50:37 [DEBUG   ] Got command RPT from MCS: ref #277617
2018-10-26 13:50:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277617  84 58417 49837410 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:50:47 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 13:51:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 13:51:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:51:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:51:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:51:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:51:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:51:11 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:51:11 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-10-26 13:51:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 13:51:47 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-26 13:52:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 13:52:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:52:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:52:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:52:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:52:11 [WARNING ] (13, 1, 'bot')
2018-10-26 13:52:11 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:52:11 [DEBUG   ] Finished updating board flags in 1.366 seconds
2018-10-26 13:52:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 13:52:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 13:53:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 13:53:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:53:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:53:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:53:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:53:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:53:12 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:53:12 [DEBUG   ] Finished updating board flags in 2.037 seconds
2018-10-26 13:53:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 13:53:35 [DEBUG   ] Got command RPT from MCS: ref #277644
2018-10-26 13:53:35 [DEBUG   ] summary = ERROR
2018-10-26 13:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277644  13 58417 50015525 A  ERRORERROR'
2018-10-26 13:53:35 [DEBUG   ] Got command RPT from MCS: ref #277645
2018-10-26 13:53:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277645  84 58417 50015729 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:53:35 [DEBUG   ] Got command RPT from MCS: ref #277646
2018-10-26 13:53:35 [DEBUG   ] summary = ERROR
2018-10-26 13:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277646  13 58417 50015933 A  ERRORERROR'
2018-10-26 13:53:36 [DEBUG   ] Got command RPT from MCS: ref #277648
2018-10-26 13:53:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277648  84 58417 50016125 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:53:36 [DEBUG   ] Got command RPT from MCS: ref #277649
2018-10-26 13:53:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 13:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277649  12 58417 50016329 A  ERRORB˜™š'
2018-10-26 13:53:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 13:54:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 13:54:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:54:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:54:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:54:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:54:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:54:12 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:54:12 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-10-26 13:54:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 13:54:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 13:55:08 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 13:55:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:55:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:55:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:55:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:55:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:55:12 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:55:12 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-10-26 13:55:28 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 13:55:37 [DEBUG   ] Got command RPT from MCS: ref #277654
2018-10-26 13:55:37 [DEBUG   ] summary = ERROR
2018-10-26 13:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277654  13 58417 50137421 A  ERRORERROR'
2018-10-26 13:55:37 [DEBUG   ] Got command RPT from MCS: ref #277655
2018-10-26 13:55:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277655  84 58417 50137422 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:55:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 13:56:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 13:56:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:56:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:56:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:56:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:56:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:56:12 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:56:12 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-10-26 13:56:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 13:56:48 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-26 13:57:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 13:57:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:57:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:57:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:57:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:57:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:57:12 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:57:12 [DEBUG   ] Finished updating board flags in 1.906 seconds
2018-10-26 13:57:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 13:57:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 13:58:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 13:58:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:58:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:58:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:58:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:58:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:58:12 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:58:12 [DEBUG   ] Finished updating board flags in 1.685 seconds
2018-10-26 13:58:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 13:58:35 [DEBUG   ] Got command RPT from MCS: ref #277675
2018-10-26 13:58:35 [DEBUG   ] summary = ERROR
2018-10-26 13:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277675  13 58417 50315609 A  ERRORERROR'
2018-10-26 13:58:35 [DEBUG   ] Got command RPT from MCS: ref #277676
2018-10-26 13:58:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277676  84 58417 50315813 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:58:36 [DEBUG   ] Got command RPT from MCS: ref #277677
2018-10-26 13:58:36 [DEBUG   ] summary = ERROR
2018-10-26 13:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277677  13 58417 50316017 A  ERRORERROR'
2018-10-26 13:58:36 [DEBUG   ] Got command RPT from MCS: ref #277678
2018-10-26 13:58:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 13:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277678  84 58417 50316221 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 13:58:36 [DEBUG   ] Got command RPT from MCS: ref #277679
2018-10-26 13:58:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 13:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277679  12 58417 50316413 A  ERRORB˜™š'
2018-10-26 13:58:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 13:59:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 13:59:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 13:59:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 13:59:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:59:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:59:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:59:12 [WARNING ] (13, 1, 'bot')
2018-10-26 13:59:12 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 13:59:12 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-26 13:59:28 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-26 13:59:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 14:00:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 14:00:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:00:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 14:00:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 14:00:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:00:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:00:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:00:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:00:12 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:00:12 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-10-26 14:00:29 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-26 14:00:37 [DEBUG   ] Got command RPT from MCS: ref #277684
2018-10-26 14:00:37 [DEBUG   ] summary = ERROR
2018-10-26 14:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277684  13 58417 50437421 A  ERRORERROR'
2018-10-26 14:00:37 [DEBUG   ] Got command RPT from MCS: ref #277685
2018-10-26 14:00:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277685  84 58417 50437422 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:00:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 14:01:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 14:01:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 14:01:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:01:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:01:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:01:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:01:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:01:12 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:01:12 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-10-26 14:01:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 14:01:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 14:02:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 14:02:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 14:02:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:02:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:02:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:02:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:02:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:02:12 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:02:12 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-10-26 14:02:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 14:02:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 14:03:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 14:03:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:03:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:03:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:03:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:03:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:03:12 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:03:12 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-10-26 14:03:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 14:03:35 [DEBUG   ] Got command RPT from MCS: ref #277707
2018-10-26 14:03:35 [DEBUG   ] summary = ERROR
2018-10-26 14:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277707  13 58417 50615697 A  ERRORERROR'
2018-10-26 14:03:35 [DEBUG   ] Got command RPT from MCS: ref #277708
2018-10-26 14:03:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277708  84 58417 50615901 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:03:36 [DEBUG   ] Got command RPT from MCS: ref #277709
2018-10-26 14:03:36 [DEBUG   ] summary = ERROR
2018-10-26 14:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277709  13 58417 50616105 A  ERRORERROR'
2018-10-26 14:03:36 [DEBUG   ] Got command RPT from MCS: ref #277711
2018-10-26 14:03:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277711  84 58417 50616297 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:03:36 [DEBUG   ] Got command RPT from MCS: ref #277712
2018-10-26 14:03:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 14:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277712  12 58417 50616501 A  ERRORB˜™š'
2018-10-26 14:03:50 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-26 14:04:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 14:04:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:04:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 14:04:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:04:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:04:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:04:12 [WARNING ] (13, 1, 'bot')
2018-10-26 14:04:12 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:04:12 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-10-26 14:04:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 14:04:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 14:05:10 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-10-26 14:05:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:05:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:05:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:05:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:05:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:05:13 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:05:13 [DEBUG   ] Finished updating board flags in 2.049 seconds
2018-10-26 14:05:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 14:05:37 [DEBUG   ] Got command RPT from MCS: ref #277721
2018-10-26 14:05:37 [DEBUG   ] summary = ERROR
2018-10-26 14:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277721  13 58417 50737417 A  ERRORERROR'
2018-10-26 14:05:37 [DEBUG   ] Got command RPT from MCS: ref #277722
2018-10-26 14:05:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277722  84 58417 50737418 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:05:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 14:06:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 14:06:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:06:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:06:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:06:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:06:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:06:13 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:06:13 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-10-26 14:06:31 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-26 14:06:51 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 14:07:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 14:07:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:07:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:07:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:07:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:07:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:07:13 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:07:13 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-10-26 14:07:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 14:07:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 14:08:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 14:08:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:08:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:08:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:08:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:08:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:08:13 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:08:13 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-26 14:08:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 14:08:35 [DEBUG   ] Got command RPT from MCS: ref #277742
2018-10-26 14:08:35 [DEBUG   ] summary = ERROR
2018-10-26 14:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277742  13 58417 50915785 A  ERRORERROR'
2018-10-26 14:08:35 [DEBUG   ] Got command RPT from MCS: ref #277743
2018-10-26 14:08:35 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277743  84 58417 50915989 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:08:36 [DEBUG   ] Got command RPT from MCS: ref #277744
2018-10-26 14:08:36 [DEBUG   ] summary = ERROR
2018-10-26 14:08:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277744  13 58417 50916193 A  ERRORERROR'
2018-10-26 14:08:36 [DEBUG   ] Got command RPT from MCS: ref #277745
2018-10-26 14:08:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:08:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277745  84 58417 50916385 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:08:36 [DEBUG   ] Got command RPT from MCS: ref #277746
2018-10-26 14:08:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 14:08:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277746  12 58417 50916589 A  ERRORB˜™š'
2018-10-26 14:08:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 14:09:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 14:09:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:09:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:09:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:09:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:09:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:09:13 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:09:13 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-26 14:09:31 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 14:09:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 14:10:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 14:10:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:10:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:10:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:10:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:10:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:10:13 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:10:13 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-10-26 14:10:31 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-10-26 14:10:37 [DEBUG   ] Got command RPT from MCS: ref #277747
2018-10-26 14:10:37 [DEBUG   ] summary = ERROR
2018-10-26 14:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277747  13 58417 51037413 A  ERRORERROR'
2018-10-26 14:10:37 [DEBUG   ] Got command RPT from MCS: ref #277748
2018-10-26 14:10:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277748  84 58417 51037414 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:10:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 14:11:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-26 14:11:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 14:11:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:11:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:11:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:11:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:11:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:11:13 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:11:13 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-10-26 14:11:32 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-26 14:11:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 14:12:12 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2018-10-26 14:12:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 14:12:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:12:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:12:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:12:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:12:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:12:13 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:12:13 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-10-26 14:12:32 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2018-10-26 14:12:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 14:13:12 [DEBUG   ] Finished updating ant stats in 1.049 seconds
2018-10-26 14:13:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:13:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:13:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:13:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:13:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:13:13 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:13:13 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-10-26 14:13:32 [DEBUG   ] Finished updating ant stats in 0.951 seconds
2018-10-26 14:13:35 [DEBUG   ] Got command RPT from MCS: ref #277770
2018-10-26 14:13:35 [DEBUG   ] summary = ERROR
2018-10-26 14:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277770  13 58417 51215873 A  ERRORERROR'
2018-10-26 14:13:36 [DEBUG   ] Got command RPT from MCS: ref #277771
2018-10-26 14:13:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:13:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277771  84 58417 51216065 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:13:36 [DEBUG   ] Got command RPT from MCS: ref #277772
2018-10-26 14:13:36 [DEBUG   ] summary = ERROR
2018-10-26 14:13:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277772  13 58417 51216269 A  ERRORERROR'
2018-10-26 14:13:36 [DEBUG   ] Got command RPT from MCS: ref #277774
2018-10-26 14:13:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:13:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277774  84 58417 51216473 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:13:36 [DEBUG   ] Got command RPT from MCS: ref #277776
2018-10-26 14:13:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 14:13:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277776  12 58417 51216677 A  ERRORB™™š'
2018-10-26 14:13:52 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-26 14:14:12 [DEBUG   ] Finished updating ant stats in 0.842 seconds
2018-10-26 14:14:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:14:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:14:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:14:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:14:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:14:13 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:14:13 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-10-26 14:14:32 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2018-10-26 14:14:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 14:15:12 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-26 14:15:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 14:15:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 14:15:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:15:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:15:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:15:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:15:13 [WARNING ] (13, 1, 'bot')
2018-10-26 14:15:13 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:15:13 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-10-26 14:15:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 14:15:37 [DEBUG   ] Got command RPT from MCS: ref #277784
2018-10-26 14:15:37 [DEBUG   ] summary = ERROR
2018-10-26 14:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277784  13 58417 51337425 A  ERRORERROR'
2018-10-26 14:15:37 [DEBUG   ] Got command RPT from MCS: ref #277785
2018-10-26 14:15:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277785  84 58417 51337426 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:15:53 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 14:16:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 14:16:13 [DEBUG   ] Finished updating ant stats in 1.256 seconds
2018-10-26 14:16:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:16:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 14:16:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:16:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:16:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:16:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:16:14 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:16:14 [DEBUG   ] Finished updating board flags in 2.055 seconds
2018-10-26 14:16:33 [DEBUG   ] Finished updating ant stats in 1.152 seconds
2018-10-26 14:16:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 14:17:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 14:17:13 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2018-10-26 14:17:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:17:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:17:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:17:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:17:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:17:14 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:17:14 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-10-26 14:17:33 [DEBUG   ] Finished updating ant stats in 0.952 seconds
2018-10-26 14:17:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 14:18:13 [DEBUG   ] Finished updating ant stats in 0.650 seconds
2018-10-26 14:18:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:18:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:18:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:18:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:18:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:18:14 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:18:14 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-10-26 14:18:33 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2018-10-26 14:18:35 [DEBUG   ] Got command RPT from MCS: ref #277805
2018-10-26 14:18:35 [DEBUG   ] summary = ERROR
2018-10-26 14:18:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277805  13 58417 51515953 A  ERRORERROR'
2018-10-26 14:18:36 [DEBUG   ] Got command RPT from MCS: ref #277806
2018-10-26 14:18:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277806  84 58417 51516157 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:18:36 [DEBUG   ] Got command RPT from MCS: ref #277807
2018-10-26 14:18:36 [DEBUG   ] summary = ERROR
2018-10-26 14:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277807  13 58417 51516361 A  ERRORERROR'
2018-10-26 14:18:36 [DEBUG   ] Got command RPT from MCS: ref #277808
2018-10-26 14:18:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277808  84 58417 51516555 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:18:36 [DEBUG   ] Got command RPT from MCS: ref #277809
2018-10-26 14:18:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 14:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277809  12 58417 51516757 A  ERRORB˜™š'
2018-10-26 14:18:53 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-26 14:19:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:19:14 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-26 14:19:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:19:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:19:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:19:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:19:14 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:19:14 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-10-26 14:19:34 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 14:19:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 14:20:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 14:20:14 [DEBUG   ] Finished updating ant stats in 1.042 seconds
2018-10-26 14:20:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:20:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:20:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:20:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:20:14 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:20:14 [DEBUG   ] Finished updating board flags in 1.677 seconds
2018-10-26 14:20:34 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2018-10-26 14:20:37 [DEBUG   ] Got command RPT from MCS: ref #277814
2018-10-26 14:20:37 [DEBUG   ] summary = ERROR
2018-10-26 14:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277814  13 58417 51637421 A  ERRORERROR'
2018-10-26 14:20:37 [DEBUG   ] Got command RPT from MCS: ref #277815
2018-10-26 14:20:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277815  84 58417 51637422 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:20:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 14:21:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:21:14 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2018-10-26 14:21:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:21:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:21:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:21:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:21:14 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:21:14 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-10-26 14:21:34 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2018-10-26 14:21:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 14:22:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:22:14 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2018-10-26 14:22:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:22:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:22:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:22:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:22:14 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:22:14 [DEBUG   ] Finished updating board flags in 1.474 seconds
2018-10-26 14:22:34 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2018-10-26 14:22:55 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-26 14:23:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:23:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:23:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:23:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:23:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:23:14 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:23:14 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-10-26 14:23:15 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 14:23:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 14:23:36 [DEBUG   ] Got command RPT from MCS: ref #277837
2018-10-26 14:23:36 [DEBUG   ] summary = ERROR
2018-10-26 14:23:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277837  13 58417 51816045 A  ERRORERROR'
2018-10-26 14:23:36 [DEBUG   ] Got command RPT from MCS: ref #277838
2018-10-26 14:23:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:23:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277838  84 58417 51816237 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:23:36 [DEBUG   ] Got command RPT from MCS: ref #277839
2018-10-26 14:23:36 [DEBUG   ] summary = ERROR
2018-10-26 14:23:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277839  13 58417 51816441 A  ERRORERROR'
2018-10-26 14:23:36 [DEBUG   ] Got command RPT from MCS: ref #277841
2018-10-26 14:23:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:23:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277841  84 58417 51816645 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:23:36 [DEBUG   ] Got command RPT from MCS: ref #277842
2018-10-26 14:23:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 14:23:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277842  12 58417 51816849 A  ERRORB™™š'
2018-10-26 14:23:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 14:24:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 14:24:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:24:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:24:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:24:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:24:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:24:14 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:24:14 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-10-26 14:24:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 14:24:35 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-26 14:24:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 14:25:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:25:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:25:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:25:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:25:14 [WARNING ] (13, 1, 'bot')
2018-10-26 14:25:14 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:25:14 [DEBUG   ] Finished updating board flags in 1.475 seconds
2018-10-26 14:25:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 14:25:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 14:25:37 [DEBUG   ] Got command RPT from MCS: ref #277847
2018-10-26 14:25:37 [DEBUG   ] summary = ERROR
2018-10-26 14:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277847  13 58417 51937425 A  ERRORERROR'
2018-10-26 14:25:37 [DEBUG   ] Got command RPT from MCS: ref #277848
2018-10-26 14:25:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277848  84 58417 51937426 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:25:55 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-26 14:26:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:26:15 [DEBUG   ] Finished updating ant stats in 0.843 seconds
2018-10-26 14:26:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:26:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:26:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:26:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:26:15 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:26:15 [DEBUG   ] Finished updating board flags in 2.221 seconds
2018-10-26 14:26:35 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-10-26 14:26:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 14:27:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:27:15 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-10-26 14:27:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:27:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:27:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:27:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:27:15 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:27:15 [DEBUG   ] Finished updating board flags in 2.165 seconds
2018-10-26 14:27:35 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2018-10-26 14:27:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 14:28:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:28:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:28:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:28:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:28:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:28:15 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:28:15 [DEBUG   ] Finished updating board flags in 2.024 seconds
2018-10-26 14:28:16 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 14:28:36 [DEBUG   ] Got command RPT from MCS: ref #277868
2018-10-26 14:28:36 [DEBUG   ] summary = ERROR
2018-10-26 14:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277868  13 58417 52116129 A  ERRORERROR'
2018-10-26 14:28:36 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 14:28:36 [DEBUG   ] Got command RPT from MCS: ref #277869
2018-10-26 14:28:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277869  84 58417 52116321 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:28:36 [DEBUG   ] Got command RPT from MCS: ref #277870
2018-10-26 14:28:36 [DEBUG   ] summary = ERROR
2018-10-26 14:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277870  13 58417 52116525 A  ERRORERROR'
2018-10-26 14:28:36 [DEBUG   ] Got command RPT from MCS: ref #277871
2018-10-26 14:28:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277871  84 58417 52116729 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:28:36 [DEBUG   ] Got command RPT from MCS: ref #277872
2018-10-26 14:28:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 14:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277872  12 58417 52116933 A  ERRORB™™š'
2018-10-26 14:28:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 14:29:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:29:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:29:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:29:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:29:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:29:15 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:29:15 [DEBUG   ] Finished updating board flags in 1.965 seconds
2018-10-26 14:29:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 14:29:36 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 14:29:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 14:30:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:30:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:30:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:30:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:30:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:30:15 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:30:15 [DEBUG   ] Finished updating board flags in 1.856 seconds
2018-10-26 14:30:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 14:30:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 14:30:37 [DEBUG   ] Got command RPT from MCS: ref #277877
2018-10-26 14:30:37 [DEBUG   ] summary = ERROR
2018-10-26 14:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277877  13 58417 52237425 A  ERRORERROR'
2018-10-26 14:30:37 [DEBUG   ] Got command RPT from MCS: ref #277878
2018-10-26 14:30:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277878  84 58417 52237426 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:30:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 14:31:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:31:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 14:31:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 14:31:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:31:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:31:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:31:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:31:16 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:31:16 [DEBUG   ] Finished updating board flags in 2.432 seconds
2018-10-26 14:31:36 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 14:31:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 14:32:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:32:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 14:32:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:32:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:32:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:32:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:32:15 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:32:15 [DEBUG   ] Finished updating board flags in 1.724 seconds
2018-10-26 14:32:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 14:32:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 14:32:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 14:33:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:33:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:33:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:33:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:33:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:33:15 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:33:15 [DEBUG   ] Finished updating board flags in 1.564 seconds
2018-10-26 14:33:17 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 14:33:36 [DEBUG   ] Got command RPT from MCS: ref #277900
2018-10-26 14:33:36 [DEBUG   ] summary = ERROR
2018-10-26 14:33:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277900  13 58417 52416206 A  ERRORERROR'
2018-10-26 14:33:36 [DEBUG   ] Got command RPT from MCS: ref #277901
2018-10-26 14:33:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:33:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277901  84 58417 52416409 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:33:36 [DEBUG   ] Got command RPT from MCS: ref #277902
2018-10-26 14:33:36 [DEBUG   ] summary = ERROR
2018-10-26 14:33:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277902  13 58417 52416613 A  ERRORERROR'
2018-10-26 14:33:36 [DEBUG   ] Got command RPT from MCS: ref #277904
2018-10-26 14:33:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:33:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277904  84 58417 52416817 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:33:37 [DEBUG   ] Got command RPT from MCS: ref #277906
2018-10-26 14:33:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 14:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277906  12 58417 52417009 A  ERRORB˜™š'
2018-10-26 14:33:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 14:33:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 14:34:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:34:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:34:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:34:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:34:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:34:15 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:34:15 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-26 14:34:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 14:34:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 14:34:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 14:35:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 14:35:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:35:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:35:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:35:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:35:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:35:15 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:35:15 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-10-26 14:35:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 14:35:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 14:35:37 [DEBUG   ] Got command RPT from MCS: ref #277914
2018-10-26 14:35:37 [DEBUG   ] summary = ERROR
2018-10-26 14:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277914  13 58417 52537421 A  ERRORERROR'
2018-10-26 14:35:37 [DEBUG   ] Got command RPT from MCS: ref #277915
2018-10-26 14:35:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277915  84 58417 52537422 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:35:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 14:36:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:36:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:36:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:36:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:36:15 [WARNING ] (13, 1, 'bot')
2018-10-26 14:36:15 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:36:15 [DEBUG   ] Finished updating board flags in 1.474 seconds
2018-10-26 14:36:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 14:36:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 14:36:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 14:37:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:37:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 14:37:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:37:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:37:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:37:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:37:16 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:37:16 [DEBUG   ] Finished updating board flags in 2.154 seconds
2018-10-26 14:37:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 14:37:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 14:37:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 14:38:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 14:38:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:38:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:38:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:38:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:38:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:38:16 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:38:16 [DEBUG   ] Finished updating board flags in 1.969 seconds
2018-10-26 14:38:18 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 14:38:36 [DEBUG   ] Got command RPT from MCS: ref #277935
2018-10-26 14:38:36 [DEBUG   ] summary = ERROR
2018-10-26 14:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277935  13 58417 52716297 A  ERRORERROR'
2018-10-26 14:38:36 [DEBUG   ] Got command RPT from MCS: ref #277936
2018-10-26 14:38:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277936  84 58417 52716489 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:38:36 [DEBUG   ] Got command RPT from MCS: ref #277937
2018-10-26 14:38:36 [DEBUG   ] summary = ERROR
2018-10-26 14:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277937  13 58417 52716693 A  ERRORERROR'
2018-10-26 14:38:36 [DEBUG   ] Got command RPT from MCS: ref #277938
2018-10-26 14:38:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277938  84 58417 52716897 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:38:37 [DEBUG   ] Got command RPT from MCS: ref #277939
2018-10-26 14:38:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 14:38:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277939  12 58417 52717101 A  ERRORB—™š'
2018-10-26 14:38:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 14:38:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 14:39:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:39:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:39:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:39:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:39:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:39:16 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:39:16 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-10-26 14:39:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 14:39:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 14:39:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 14:40:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:40:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:40:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:40:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:40:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:40:16 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:40:16 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-10-26 14:40:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 14:40:37 [DEBUG   ] Got command RPT from MCS: ref #277940
2018-10-26 14:40:37 [DEBUG   ] summary = ERROR
2018-10-26 14:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277940  13 58417 52837422 A  ERRORERROR'
2018-10-26 14:40:37 [DEBUG   ] Got command RPT from MCS: ref #277941
2018-10-26 14:40:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277941  84 58417 52837422 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:40:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 14:40:58 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-26 14:41:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:41:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 14:41:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:41:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:41:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:41:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:41:16 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:41:16 [DEBUG   ] Finished updating board flags in 1.766 seconds
2018-10-26 14:41:18 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-10-26 14:41:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 14:41:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 14:42:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:42:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-26 14:42:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:42:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:42:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:42:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:42:16 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:42:16 [DEBUG   ] Finished updating board flags in 1.669 seconds
2018-10-26 14:42:18 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-26 14:42:38 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 14:42:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 14:43:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:43:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 14:43:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:43:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:43:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:43:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:43:16 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:43:16 [DEBUG   ] Finished updating board flags in 1.523 seconds
2018-10-26 14:43:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 14:43:36 [DEBUG   ] Got command RPT from MCS: ref #277963
2018-10-26 14:43:36 [DEBUG   ] summary = ERROR
2018-10-26 14:43:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277963  13 58417 53016381 A  ERRORERROR'
2018-10-26 14:43:36 [DEBUG   ] Got command RPT from MCS: ref #277964
2018-10-26 14:43:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:43:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277964  84 58417 53016585 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:43:36 [DEBUG   ] Got command RPT from MCS: ref #277965
2018-10-26 14:43:36 [DEBUG   ] summary = ERROR
2018-10-26 14:43:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277965  13 58417 53016777 A  ERRORERROR'
2018-10-26 14:43:36 [DEBUG   ] Got command RPT from MCS: ref #277967
2018-10-26 14:43:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:43:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277967  84 58417 53016981 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:43:37 [DEBUG   ] Got command RPT from MCS: ref #277968
2018-10-26 14:43:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 14:43:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277968  12 58417 53017185 A  ERRORB˜™š'
2018-10-26 14:43:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 14:43:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 14:44:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 14:44:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:44:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:44:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:44:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:44:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:44:16 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:44:16 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-10-26 14:44:19 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 14:44:39 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-26 14:44:59 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 14:45:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:45:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:45:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:45:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:45:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:45:16 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:45:16 [DEBUG   ] Finished updating board flags in 1.372 seconds
2018-10-26 14:45:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 14:45:37 [DEBUG   ] Got command RPT from MCS: ref #277977
2018-10-26 14:45:37 [DEBUG   ] summary = ERROR
2018-10-26 14:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277977  13 58417 53137429 A  ERRORERROR'
2018-10-26 14:45:37 [DEBUG   ] Got command RPT from MCS: ref #277978
2018-10-26 14:45:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277978  84 58417 53137430 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:45:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 14:45:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 14:46:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:46:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:46:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:46:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:46:16 [WARNING ] (13, 1, 'bot')
2018-10-26 14:46:16 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:46:16 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-10-26 14:46:19 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-26 14:46:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 14:46:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 14:47:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:47:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:47:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:47:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:47:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:47:17 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:47:17 [DEBUG   ] Finished updating board flags in 2.023 seconds
2018-10-26 14:47:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 14:47:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 14:47:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 14:48:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:48:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:48:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:48:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:48:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:48:17 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:48:17 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-10-26 14:48:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 14:48:36 [DEBUG   ] Got command RPT from MCS: ref #277998
2018-10-26 14:48:36 [DEBUG   ] summary = ERROR
2018-10-26 14:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277998  13 58417 53316461 A  ERRORERROR'
2018-10-26 14:48:36 [DEBUG   ] Got command RPT from MCS: ref #277999
2018-10-26 14:48:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   277999  84 58417 53316665 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:48:36 [DEBUG   ] Got command RPT from MCS: ref #278000
2018-10-26 14:48:36 [DEBUG   ] summary = ERROR
2018-10-26 14:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278000  13 58417 53316869 A  ERRORERROR'
2018-10-26 14:48:37 [DEBUG   ] Got command RPT from MCS: ref #278001
2018-10-26 14:48:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:48:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278001  84 58417 53317073 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:48:37 [DEBUG   ] Got command RPT from MCS: ref #278002
2018-10-26 14:48:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 14:48:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278002  12 58417 53317265 A  ERRORB˜™š'
2018-10-26 14:48:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 14:48:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 14:49:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:49:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:49:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:49:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:49:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:49:17 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:49:17 [DEBUG   ] Finished updating board flags in 2.023 seconds
2018-10-26 14:49:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 14:49:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 14:49:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 14:50:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:50:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:50:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:50:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:50:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:50:17 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:50:17 [DEBUG   ] Finished updating board flags in 1.973 seconds
2018-10-26 14:50:20 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 14:50:37 [DEBUG   ] Got command RPT from MCS: ref #278007
2018-10-26 14:50:37 [DEBUG   ] summary = ERROR
2018-10-26 14:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278007  13 58417 53437433 A  ERRORERROR'
2018-10-26 14:50:37 [DEBUG   ] Got command RPT from MCS: ref #278008
2018-10-26 14:50:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278008  84 58417 53437434 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:50:40 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 14:51:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 14:51:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:51:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:51:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:51:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:51:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:51:17 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:51:17 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-10-26 14:51:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 14:51:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 14:52:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 14:52:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:52:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:52:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:52:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:52:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:52:17 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:52:17 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-10-26 14:52:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 14:52:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 14:53:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 14:53:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:53:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:53:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:53:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:53:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:53:17 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:53:17 [DEBUG   ] Finished updating board flags in 1.574 seconds
2018-10-26 14:53:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 14:53:36 [DEBUG   ] Got command RPT from MCS: ref #278030
2018-10-26 14:53:36 [DEBUG   ] summary = ERROR
2018-10-26 14:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278030  13 58417 53616549 A  ERRORERROR'
2018-10-26 14:53:36 [DEBUG   ] Got command RPT from MCS: ref #278031
2018-10-26 14:53:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278031  84 58417 53616753 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:53:36 [DEBUG   ] Got command RPT from MCS: ref #278032
2018-10-26 14:53:36 [DEBUG   ] summary = ERROR
2018-10-26 14:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278032  13 58417 53616957 A  ERRORERROR'
2018-10-26 14:53:37 [DEBUG   ] Got command RPT from MCS: ref #278034
2018-10-26 14:53:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:53:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278034  84 58417 53617149 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:53:37 [DEBUG   ] Got command RPT from MCS: ref #278036
2018-10-26 14:53:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 14:53:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278036  12 58417 53617353 A  ERRORB—™š'
2018-10-26 14:53:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 14:54:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 14:54:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 14:54:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:54:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:54:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:54:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:54:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:54:17 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:54:17 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-26 14:54:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 14:54:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 14:55:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 14:55:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:55:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:55:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:55:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:55:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:55:17 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:55:17 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-10-26 14:55:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 14:55:37 [DEBUG   ] Got command RPT from MCS: ref #278040
2018-10-26 14:55:37 [DEBUG   ] summary = ERROR
2018-10-26 14:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278040  13 58417 53737433 A  ERRORERROR'
2018-10-26 14:55:37 [DEBUG   ] Got command RPT from MCS: ref #278041
2018-10-26 14:55:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278041  84 58417 53737434 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:55:41 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 14:56:01 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 14:56:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 14:56:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:56:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:56:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:56:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:56:17 [WARNING ] (13, 1, 'bot')
2018-10-26 14:56:17 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:56:17 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-10-26 14:56:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 14:56:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 14:57:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-26 14:57:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:57:18 [WARNING ] (13, 1, 'bot')
2018-10-26 14:57:18 [WARNING ] (13, 1, 'bot')
2018-10-26 14:57:18 [WARNING ] (13, 1, 'bot')
2018-10-26 14:57:18 [WARNING ] (13, 1, 'bot')
2018-10-26 14:57:18 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:57:18 [DEBUG   ] Finished updating board flags in 2.036 seconds
2018-10-26 14:57:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 14:57:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 14:58:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 14:58:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 14:58:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:58:18 [WARNING ] (13, 1, 'bot')
2018-10-26 14:58:18 [WARNING ] (13, 1, 'bot')
2018-10-26 14:58:18 [WARNING ] (13, 1, 'bot')
2018-10-26 14:58:18 [WARNING ] (13, 1, 'bot')
2018-10-26 14:58:18 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:58:18 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-10-26 14:58:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 14:58:36 [DEBUG   ] Got command RPT from MCS: ref #278061
2018-10-26 14:58:36 [DEBUG   ] summary = ERROR
2018-10-26 14:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278061  13 58417 53916641 A  ERRORERROR'
2018-10-26 14:58:36 [DEBUG   ] Got command RPT from MCS: ref #278062
2018-10-26 14:58:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278062  84 58417 53916845 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:58:37 [DEBUG   ] Got command RPT from MCS: ref #278063
2018-10-26 14:58:37 [DEBUG   ] summary = ERROR
2018-10-26 14:58:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278063  13 58417 53917037 A  ERRORERROR'
2018-10-26 14:58:37 [DEBUG   ] Got command RPT from MCS: ref #278064
2018-10-26 14:58:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 14:58:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278064  84 58417 53917241 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 14:58:37 [DEBUG   ] Got command RPT from MCS: ref #278065
2018-10-26 14:58:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 14:58:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278065  12 58417 53917445 A  ERRORB˜™š'
2018-10-26 14:58:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 14:59:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 14:59:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 14:59:18 [WARNING ] (13, 1, 'bot')
2018-10-26 14:59:18 [WARNING ] (13, 1, 'bot')
2018-10-26 14:59:18 [WARNING ] (13, 1, 'bot')
2018-10-26 14:59:18 [WARNING ] (13, 1, 'bot')
2018-10-26 14:59:18 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 14:59:18 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-10-26 14:59:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 14:59:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 15:00:01 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 15:00:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:00:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 15:00:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:00:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:00:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:00:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:00:18 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:00:18 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-26 15:00:22 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 15:00:37 [DEBUG   ] Got command RPT from MCS: ref #278070
2018-10-26 15:00:37 [DEBUG   ] summary = ERROR
2018-10-26 15:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278070  13 58417 54037425 A  ERRORERROR'
2018-10-26 15:00:37 [DEBUG   ] Got command RPT from MCS: ref #278071
2018-10-26 15:00:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278071  84 58417 54037426 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:00:42 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 15:01:02 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 15:01:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:01:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:01:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:01:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:01:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:01:18 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:01:18 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-10-26 15:01:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 15:01:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 15:02:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 15:02:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 15:02:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:02:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:02:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:02:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:02:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:02:18 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:02:18 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-10-26 15:02:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 15:02:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:03:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 15:03:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 15:03:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:03:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:03:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:03:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:03:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:03:18 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:03:18 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-10-26 15:03:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 15:03:36 [DEBUG   ] Got command RPT from MCS: ref #278093
2018-10-26 15:03:36 [DEBUG   ] summary = ERROR
2018-10-26 15:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278093  13 58417 54216729 A  ERRORERROR'
2018-10-26 15:03:36 [DEBUG   ] Got command RPT from MCS: ref #278094
2018-10-26 15:03:36 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278094  84 58417 54216933 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:03:37 [DEBUG   ] Got command RPT from MCS: ref #278095
2018-10-26 15:03:37 [DEBUG   ] summary = ERROR
2018-10-26 15:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278095  13 58417 54217125 A  ERRORERROR'
2018-10-26 15:03:37 [DEBUG   ] Got command RPT from MCS: ref #278097
2018-10-26 15:03:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278097  84 58417 54217329 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:03:37 [DEBUG   ] Got command RPT from MCS: ref #278098
2018-10-26 15:03:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 15:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278098  12 58417 54217533 A  ERRORB˜™š'
2018-10-26 15:03:42 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 15:04:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 15:04:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:04:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:04:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:04:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:04:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:04:18 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:04:18 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-26 15:04:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 15:04:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 15:05:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 15:05:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:05:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:05:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:05:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:05:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:05:18 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:05:18 [DEBUG   ] Finished updating board flags in 1.442 seconds
2018-10-26 15:05:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 15:05:37 [DEBUG   ] Got command RPT from MCS: ref #278107
2018-10-26 15:05:37 [DEBUG   ] summary = ERROR
2018-10-26 15:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278107  13 58417 54337433 A  ERRORERROR'
2018-10-26 15:05:37 [DEBUG   ] Got command RPT from MCS: ref #278108
2018-10-26 15:05:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278108  84 58417 54337434 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:05:43 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 15:06:03 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 15:06:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:06:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:06:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:06:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:06:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:06:18 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:06:18 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-10-26 15:06:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 15:06:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 15:07:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 15:07:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:07:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:07:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:07:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:07:18 [WARNING ] (13, 1, 'bot')
2018-10-26 15:07:18 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:07:18 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-10-26 15:07:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 15:07:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 15:08:03 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-26 15:08:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:08:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:08:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:08:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:08:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:08:19 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:08:19 [DEBUG   ] Finished updating board flags in 2.038 seconds
2018-10-26 15:08:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 15:08:36 [DEBUG   ] Got command RPT from MCS: ref #278128
2018-10-26 15:08:36 [DEBUG   ] summary = ERROR
2018-10-26 15:08:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278128  13 58417 54516817 A  ERRORERROR'
2018-10-26 15:08:37 [DEBUG   ] Got command RPT from MCS: ref #278129
2018-10-26 15:08:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:08:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278129  84 58417 54517021 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:08:37 [DEBUG   ] Got command RPT from MCS: ref #278130
2018-10-26 15:08:37 [DEBUG   ] summary = ERROR
2018-10-26 15:08:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278130  13 58417 54517213 A  ERRORERROR'
2018-10-26 15:08:37 [DEBUG   ] Got command RPT from MCS: ref #278131
2018-10-26 15:08:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:08:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278131  84 58417 54517417 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:08:37 [DEBUG   ] Got command RPT from MCS: ref #278132
2018-10-26 15:08:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 15:08:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278132  12 58417 54517621 A  ERRORB˜™š'
2018-10-26 15:08:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 15:09:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:09:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:09:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:09:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:09:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:09:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:09:19 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:09:19 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-10-26 15:09:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 15:09:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:10:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 15:10:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:10:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:10:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:10:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:10:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:10:19 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:10:19 [DEBUG   ] Finished updating board flags in 2.035 seconds
2018-10-26 15:10:23 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 15:10:37 [DEBUG   ] Got command RPT from MCS: ref #278133
2018-10-26 15:10:37 [DEBUG   ] summary = ERROR
2018-10-26 15:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278133  13 58417 54637433 A  ERRORERROR'
2018-10-26 15:10:37 [DEBUG   ] Got command RPT from MCS: ref #278134
2018-10-26 15:10:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278134  84 58417 54637434 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:10:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 15:11:03 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 15:11:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:11:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:11:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:11:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:11:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:11:19 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:11:19 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-26 15:11:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 15:11:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 15:12:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-26 15:12:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:12:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:12:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:12:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:12:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:12:19 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:12:19 [DEBUG   ] Finished updating board flags in 1.952 seconds
2018-10-26 15:12:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 15:12:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 15:13:04 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-26 15:13:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 15:13:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:13:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:13:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:13:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:13:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:13:19 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:13:19 [DEBUG   ] Finished updating board flags in 1.836 seconds
2018-10-26 15:13:23 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-26 15:13:36 [DEBUG   ] Got command RPT from MCS: ref #278156
2018-10-26 15:13:36 [DEBUG   ] summary = ERROR
2018-10-26 15:13:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278156  13 58417 54816897 A  ERRORERROR'
2018-10-26 15:13:37 [DEBUG   ] Got command RPT from MCS: ref #278157
2018-10-26 15:13:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278157  84 58417 54817101 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:13:37 [DEBUG   ] Got command RPT from MCS: ref #278158
2018-10-26 15:13:37 [DEBUG   ] summary = ERROR
2018-10-26 15:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278158  13 58417 54817305 A  ERRORERROR'
2018-10-26 15:13:37 [DEBUG   ] Got command RPT from MCS: ref #278160
2018-10-26 15:13:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278160  84 58417 54817509 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:13:37 [DEBUG   ] Got command RPT from MCS: ref #278162
2018-10-26 15:13:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 15:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278162  12 58417 54817701 A  ERRORB˜™š'
2018-10-26 15:13:44 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-26 15:14:04 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 15:14:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 15:14:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 15:14:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:14:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:14:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:14:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:14:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:14:19 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:14:19 [DEBUG   ] Finished updating board flags in 1.766 seconds
2018-10-26 15:14:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 15:14:44 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 15:15:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:15:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:15:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:15:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:15:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:15:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:15:19 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:15:19 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-26 15:15:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:15:37 [DEBUG   ] Got command RPT from MCS: ref #278170
2018-10-26 15:15:37 [DEBUG   ] summary = ERROR
2018-10-26 15:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278170  13 58417 54937437 A  ERRORERROR'
2018-10-26 15:15:37 [DEBUG   ] Got command RPT from MCS: ref #278171
2018-10-26 15:15:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278171  84 58417 54937438 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:15:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 15:16:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 15:16:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 15:16:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:16:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:16:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:16:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:16:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:16:19 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:16:19 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-10-26 15:16:24 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 15:16:45 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 15:17:05 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 15:17:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 15:17:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:17:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 15:17:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:17:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:17:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:17:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:17:19 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:17:19 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-10-26 15:17:25 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 15:17:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 15:18:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 15:18:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:18:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 15:18:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:18:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:18:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:18:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:18:19 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:18:19 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-10-26 15:18:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 15:18:36 [DEBUG   ] Got command RPT from MCS: ref #278191
2018-10-26 15:18:36 [DEBUG   ] summary = ERROR
2018-10-26 15:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278191  13 58417 55116985 A  ERRORERROR'
2018-10-26 15:18:37 [DEBUG   ] Got command RPT from MCS: ref #278192
2018-10-26 15:18:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:18:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278192  84 58417 55117189 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:18:37 [DEBUG   ] Got command RPT from MCS: ref #278193
2018-10-26 15:18:37 [DEBUG   ] summary = ERROR
2018-10-26 15:18:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278193  13 58417 55117393 A  ERRORERROR'
2018-10-26 15:18:37 [DEBUG   ] Got command RPT from MCS: ref #278194
2018-10-26 15:18:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:18:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278194  84 58417 55117585 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:18:37 [DEBUG   ] Got command RPT from MCS: ref #278195
2018-10-26 15:18:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 15:18:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278195  12 58417 55117789 A  ERRORB™™š'
2018-10-26 15:18:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 15:19:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 15:19:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 15:19:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:19:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:19:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:19:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:19:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:19:19 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:19:19 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-10-26 15:19:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 15:19:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 15:20:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 15:20:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:20:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:20:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:20:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:20:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:20:19 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:20:19 [DEBUG   ] Finished updating board flags in 1.529 seconds
2018-10-26 15:20:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 15:20:37 [DEBUG   ] Got command RPT from MCS: ref #278200
2018-10-26 15:20:37 [DEBUG   ] summary = ERROR
2018-10-26 15:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278200  13 58417 55237433 A  ERRORERROR'
2018-10-26 15:20:37 [DEBUG   ] Got command RPT from MCS: ref #278201
2018-10-26 15:20:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278201  84 58417 55237434 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:20:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 15:21:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 15:21:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 15:21:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 15:21:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:21:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:21:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:21:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:21:19 [WARNING ] (13, 1, 'bot')
2018-10-26 15:21:19 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:21:19 [DEBUG   ] Finished updating board flags in 1.538 seconds
2018-10-26 15:21:25 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-10-26 15:21:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 15:22:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 15:22:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 15:22:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:22:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:22:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:22:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:22:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:22:20 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:22:20 [DEBUG   ] Finished updating board flags in 2.179 seconds
2018-10-26 15:22:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 15:22:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 15:23:06 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 15:23:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:23:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:23:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:23:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:23:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:23:20 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:23:20 [DEBUG   ] Finished updating board flags in 1.916 seconds
2018-10-26 15:23:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 15:23:37 [DEBUG   ] Got command RPT from MCS: ref #278223
2018-10-26 15:23:37 [DEBUG   ] summary = ERROR
2018-10-26 15:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278223  13 58417 55417081 A  ERRORERROR'
2018-10-26 15:23:37 [DEBUG   ] Got command RPT from MCS: ref #278224
2018-10-26 15:23:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278224  84 58417 55417273 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:23:37 [DEBUG   ] Got command RPT from MCS: ref #278225
2018-10-26 15:23:37 [DEBUG   ] summary = ERROR
2018-10-26 15:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278225  13 58417 55417477 A  ERRORERROR'
2018-10-26 15:23:37 [DEBUG   ] Got command RPT from MCS: ref #278227
2018-10-26 15:23:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278227  84 58417 55417681 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:23:37 [DEBUG   ] Got command RPT from MCS: ref #278228
2018-10-26 15:23:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 15:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278228  12 58417 55417873 A  ERRORB˜™š'
2018-10-26 15:23:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 15:24:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 15:24:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 15:24:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:24:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:24:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:24:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:24:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:24:20 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:24:20 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-10-26 15:24:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 15:24:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 15:25:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 15:25:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:25:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:25:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:25:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:25:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:25:20 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:25:20 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-26 15:25:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 15:25:37 [DEBUG   ] Got command RPT from MCS: ref #278233
2018-10-26 15:25:37 [DEBUG   ] summary = ERROR
2018-10-26 15:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278233  13 58417 55537441 A  ERRORERROR'
2018-10-26 15:25:37 [DEBUG   ] Got command RPT from MCS: ref #278234
2018-10-26 15:25:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278234  84 58417 55537442 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:25:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 15:26:06 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-26 15:26:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:26:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:26:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:26:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:26:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:26:20 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:26:20 [DEBUG   ] Finished updating board flags in 1.779 seconds
2018-10-26 15:26:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:26:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 15:27:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 15:27:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:27:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:27:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:27:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:27:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:27:20 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:27:20 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-26 15:27:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 15:27:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 15:28:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 15:28:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:28:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:28:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:28:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:28:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:28:20 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:28:20 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-10-26 15:28:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 15:28:37 [DEBUG   ] Got command RPT from MCS: ref #278254
2018-10-26 15:28:37 [DEBUG   ] summary = ERROR
2018-10-26 15:28:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278254  13 58417 55717169 A  ERRORERROR'
2018-10-26 15:28:37 [DEBUG   ] Got command RPT from MCS: ref #278255
2018-10-26 15:28:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:28:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278255  84 58417 55717361 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:28:37 [DEBUG   ] Got command RPT from MCS: ref #278256
2018-10-26 15:28:37 [DEBUG   ] summary = ERROR
2018-10-26 15:28:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278256  13 58417 55717565 A  ERRORERROR'
2018-10-26 15:28:37 [DEBUG   ] Got command RPT from MCS: ref #278257
2018-10-26 15:28:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:28:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278257  84 58417 55717769 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:28:37 [DEBUG   ] Got command RPT from MCS: ref #278258
2018-10-26 15:28:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 15:28:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278258  12 58417 55717961 A  ERRORB˜™š'
2018-10-26 15:28:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 15:29:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 15:29:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:29:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:29:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:29:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:29:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:29:20 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:29:20 [DEBUG   ] Finished updating board flags in 1.635 seconds
2018-10-26 15:29:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 15:29:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 15:30:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 15:30:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 15:30:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:30:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:30:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:30:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:30:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:30:20 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:30:20 [DEBUG   ] Finished updating board flags in 1.573 seconds
2018-10-26 15:30:27 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-26 15:30:37 [DEBUG   ] Got command RPT from MCS: ref #278263
2018-10-26 15:30:37 [DEBUG   ] summary = ERROR
2018-10-26 15:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278263  13 58417 55837433 A  ERRORERROR'
2018-10-26 15:30:37 [DEBUG   ] Got command RPT from MCS: ref #278264
2018-10-26 15:30:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278264  84 58417 55837434 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:30:47 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 15:31:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 15:31:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:31:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:31:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:31:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:31:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:31:20 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:31:20 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-26 15:31:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 15:31:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 15:32:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 15:32:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:32:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:32:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:32:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:32:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:32:20 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:32:20 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-10-26 15:32:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 15:32:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 15:33:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 15:33:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:33:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:33:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:33:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:33:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:33:20 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:33:20 [DEBUG   ] Finished updating board flags in 1.667 seconds
2018-10-26 15:33:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 15:33:37 [DEBUG   ] Got command RPT from MCS: ref #278286
2018-10-26 15:33:37 [DEBUG   ] summary = ERROR
2018-10-26 15:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278286  13 58417 56017241 A  ERRORERROR'
2018-10-26 15:33:37 [DEBUG   ] Got command RPT from MCS: ref #278287
2018-10-26 15:33:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278287  84 58417 56017445 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:33:37 [DEBUG   ] Got command RPT from MCS: ref #278288
2018-10-26 15:33:37 [DEBUG   ] summary = ERROR
2018-10-26 15:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278288  13 58417 56017672 A  ERRORERROR'
2018-10-26 15:33:37 [DEBUG   ] Got command RPT from MCS: ref #278289
2018-10-26 15:33:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278289  84 58417 56017849 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:33:38 [DEBUG   ] Got command RPT from MCS: ref #278291
2018-10-26 15:33:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 15:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278291  12 58417 56018053 A  ERRORB—™š'
2018-10-26 15:33:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 15:34:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:34:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:34:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:34:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:34:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:34:20 [WARNING ] (13, 1, 'bot')
2018-10-26 15:34:20 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:34:20 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-10-26 15:34:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 15:34:47 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 15:35:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 15:35:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:35:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 15:35:21 [WARNING ] (13, 1, 'bot')
2018-10-26 15:35:21 [WARNING ] (13, 1, 'bot')
2018-10-26 15:35:21 [WARNING ] (13, 1, 'bot')
2018-10-26 15:35:21 [WARNING ] (13, 1, 'bot')
2018-10-26 15:35:21 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:35:21 [DEBUG   ] Finished updating board flags in 2.123 seconds
2018-10-26 15:35:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 15:35:37 [DEBUG   ] Got command RPT from MCS: ref #278300
2018-10-26 15:35:37 [DEBUG   ] summary = ERROR
2018-10-26 15:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278300  13 58417 56137441 A  ERRORERROR'
2018-10-26 15:35:37 [DEBUG   ] Got command RPT from MCS: ref #278301
2018-10-26 15:35:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278301  84 58417 56137442 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:35:47 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-26 15:36:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 15:36:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:36:21 [WARNING ] (13, 1, 'bot')
2018-10-26 15:36:21 [WARNING ] (13, 1, 'bot')
2018-10-26 15:36:21 [WARNING ] (13, 1, 'bot')
2018-10-26 15:36:21 [WARNING ] (13, 1, 'bot')
2018-10-26 15:36:21 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:36:21 [DEBUG   ] Finished updating board flags in 2.070 seconds
2018-10-26 15:36:28 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 15:36:48 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 15:37:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 15:37:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:37:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 15:37:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 15:37:21 [WARNING ] (13, 1, 'bot')
2018-10-26 15:37:21 [WARNING ] (13, 1, 'bot')
2018-10-26 15:37:21 [WARNING ] (13, 1, 'bot')
2018-10-26 15:37:21 [WARNING ] (13, 1, 'bot')
2018-10-26 15:37:21 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:37:21 [DEBUG   ] Finished updating board flags in 1.912 seconds
2018-10-26 15:37:28 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 15:37:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 15:38:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 15:38:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:38:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 15:38:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 15:38:21 [WARNING ] (13, 1, 'bot')
2018-10-26 15:38:21 [WARNING ] (13, 1, 'bot')
2018-10-26 15:38:21 [WARNING ] (13, 1, 'bot')
2018-10-26 15:38:21 [WARNING ] (13, 1, 'bot')
2018-10-26 15:38:21 [CRITICAL] MGT underflow detected on beam(s) 1, 4
2018-10-26 15:38:21 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-10-26 15:38:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 15:38:37 [DEBUG   ] Got command RPT from MCS: ref #278321
2018-10-26 15:38:37 [DEBUG   ] summary = ERROR
2018-10-26 15:38:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278321  13 58417 56317329 A  ERRORERROR'
2018-10-26 15:38:37 [DEBUG   ] Got command RPT from MCS: ref #278322
2018-10-26 15:38:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:38:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278322  84 58417 56317533 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:38:37 [DEBUG   ] Got command RPT from MCS: ref #278323
2018-10-26 15:38:37 [DEBUG   ] summary = ERROR
2018-10-26 15:38:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278323  13 58417 56317737 A  ERRORERROR'
2018-10-26 15:38:37 [DEBUG   ] Got command RPT from MCS: ref #278324
2018-10-26 15:38:37 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:38:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278324  84 58417 56317929 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:38:38 [DEBUG   ] Got command RPT from MCS: ref #278325
2018-10-26 15:38:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 15:38:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278325  12 58417 56318133 A  ERRORB™™š'
2018-10-26 15:38:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 15:39:00 [DEBUG   ] Got command RPT from MCS: ref #278326
2018-10-26 15:39:00 [DEBUG   ] summary = ERROR
2018-10-26 15:39:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278326  13 58417 56340537 A  ERRORERROR'
2018-10-26 15:39:00 [DEBUG   ] Got command RPT from MCS: ref #278327
2018-10-26 15:39:00 [DEBUG   ] info = T_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:39:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278327  84 58417 56340538 A  ERRORT_NOM1 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:39:05 [DEBUG   ] Got command INI from MCS: ref #278328
2018-10-26 15:39:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-10-26 15:39:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   278328   8 58417 56345546 ABOOTING'
2018-10-26 15:39:08 [DEBUG   ] Finished updating ant stats in 0.635 seconds
2018-10-26 15:39:20 [DEBUG   ] Finished updating board flags in 0.171 seconds
2018-10-26 15:39:29 [INFO    ] -------------------
2018-10-26 15:39:29 [INFO    ]  LWA board status
2018-10-26 15:39:29 [INFO    ] -------------------
2018-10-26 15:39:29 [INFO    ] DP 1: 2 lwa27
2018-10-26 15:39:29 [INFO    ] DP 1: 3 lwa24
2018-10-26 15:39:29 [INFO    ] DP 1: 4 lwa23
2018-10-26 15:39:29 [INFO    ] DP 1: 5 lwa18
2018-10-26 15:39:29 [INFO    ] DP 1: 6 lwa10
2018-10-26 15:39:29 [INFO    ] DP 1: 7 lwa32
2018-10-26 15:39:29 [INFO    ] DP 1: 8 lwa11
2018-10-26 15:39:29 [INFO    ] DP 1: 9 lwa30
2018-10-26 15:39:29 [INFO    ] DP 1: 10 lwa12
2018-10-26 15:39:29 [INFO    ] DP 1: 11 lwa8
2018-10-26 15:39:29 [INFO    ] DP 1: 12 lwa13
2018-10-26 15:39:29 [INFO    ] DP 1: 13 lwa26
2018-10-26 15:39:29 [INFO    ] DP 1: 14 lwa14
2018-10-26 15:39:29 [INFO    ] DP 1: 16 lwa22
2018-10-26 15:39:29 [INFO    ] DP 1: 17 lwa20
2018-10-26 15:39:29 [INFO    ] DP 1: 18 lwa1
2018-10-26 15:39:29 [INFO    ] DP 1: 19 lwa5
2018-10-26 15:39:29 [INFO    ] DP 1: 20 lwa25
2018-10-26 15:39:29 [INFO    ] DP 1: 21 lwa35
2018-10-26 15:39:29 [INFO    ] DP 1: 22 lwa19
2018-10-26 15:39:29 [INFO    ] DP 1: 23 lwa21
2018-10-26 15:39:29 [INFO    ] DP 1: 24 lwa6
2018-10-26 15:39:29 [INFO    ] DP 1: 25 lwa7
2018-10-26 15:39:29 [INFO    ] DP 1: 26 lwa33
2018-10-26 15:39:29 [INFO    ] DP 1: 27 lwa15
2018-10-26 15:39:29 [INFO    ] DP 1: 28 lwa28
2018-10-26 15:39:29 [INFO    ] DP 2: 1 lwa16
2018-10-26 15:39:29 [INFO    ] DP 2: 15 lwa34
2018-10-26 15:39:29 [INFO    ] Total of 28 boards
2018-10-26 15:39:29 [INFO    ] Total of 260 stands
2018-10-26 15:39:29 [INFO    ] -------------------
2018-10-26 15:39:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2485
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2486
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2487
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2488
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2489
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2490
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2491
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2492
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2493
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2494
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2495
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2496
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2497
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2498
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2499
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2500
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2501
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2502
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2503
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2504
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2505
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2506
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2507
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2508
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2509
2018-10-26 15:39:37 [DEBUG   ] 2018-10-26 15:39:37 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2510
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2485 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2486 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2487 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2488 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2489 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2490 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2491 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2492 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2493 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2494 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2495 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2496 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2497 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2498 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2499 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2500 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2501 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2502 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2503 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2504 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2505 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2506 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2507 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2508 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2509 exited with status 0
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2510 exited with status 0
2018-10-26 15:39:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] spawn_process: at 2018-10-26 15:39:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 2537
2018-10-26 15:39:49 [DEBUG   ] 2018-10-26 15:39:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 2538
2018-10-26 15:39:55 [DEBUG   ] 2018-10-26 15:39:55 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 2537 exited with status 0
2018-10-26 15:39:55 [DEBUG   ] 2018-10-26 15:39:55 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 2538 exited with status 0
2018-10-26 15:39:55 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-10-26 15:39:55 [DEBUG   ] spawn_process: at 2018-10-26 15:39:55 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-10-26 15:39:55 [DEBUG   ] spawn_process: at 2018-10-26 15:39:55 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-10-26 15:39:55 [INFO    ] Setting Beam 1 xbars
2018-10-26 15:39:55 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-10-26 15:39:55 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-10-26 15:39:55 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-10-26 15:39:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-10-26 15:39:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-10-26 15:39:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-10-26 15:39:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-10-26 15:39:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-10-26 15:39:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-10-26 15:39:56 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-10-26 15:39:56 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-10-26 15:39:56 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-10-26 15:39:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-10-26 15:39:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-10-26 15:39:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-10-26 15:39:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-10-26 15:39:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-10-26 15:39:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-10-26 15:39:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-10-26 15:39:57 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-10-26 15:39:57 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-10-26 15:39:57 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-10-26 15:39:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-10-26 15:39:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-10-26 15:39:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-10-26 15:39:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-10-26 15:39:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-10-26 15:39:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-10-26 15:39:58 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-10-26 15:39:58 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-10-26 15:39:58 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-10-26 15:39:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-10-26 15:39:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-10-26 15:39:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-10-26 15:39:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-10-26 15:39:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-10-26 15:39:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-10-26 15:39:59 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-10-26 15:39:59 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-10-26 15:39:59 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-10-26 15:39:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-10-26 15:39:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-10-26 15:39:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-10-26 15:39:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-10-26 15:39:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-10-26 15:39:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-10-26 15:40:00 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-10-26 15:40:00 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-10-26 15:40:00 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-10-26 15:40:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-10-26 15:40:00 [INFO    ] Setting Beam 2 xbars
2018-10-26 15:40:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-10-26 15:40:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-10-26 15:40:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-10-26 15:40:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-10-26 15:40:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-10-26 15:40:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-10-26 15:40:01 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-10-26 15:40:01 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-10-26 15:40:01 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-10-26 15:40:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-10-26 15:40:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-10-26 15:40:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-10-26 15:40:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-10-26 15:40:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-10-26 15:40:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-10-26 15:40:02 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-10-26 15:40:02 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-10-26 15:40:02 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-10-26 15:40:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-10-26 15:40:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-10-26 15:40:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-10-26 15:40:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-10-26 15:40:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-10-26 15:40:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-10-26 15:40:03 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-10-26 15:40:03 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-10-26 15:40:03 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-10-26 15:40:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-10-26 15:40:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-10-26 15:40:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-10-26 15:40:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-10-26 15:40:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-10-26 15:40:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-10-26 15:40:04 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-10-26 15:40:04 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-10-26 15:40:04 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-10-26 15:40:04 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-10-26 15:40:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-10-26 15:40:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-10-26 15:40:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-10-26 15:40:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-10-26 15:40:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-10-26 15:40:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-10-26 15:40:05 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-10-26 15:40:05 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-10-26 15:40:05 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-10-26 15:40:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-10-26 15:40:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-10-26 15:40:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-10-26 15:40:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-10-26 15:40:05 [INFO    ] Setting Beam 3 xbars
2018-10-26 15:40:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-10-26 15:40:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-10-26 15:40:06 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-10-26 15:40:06 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-10-26 15:40:06 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-10-26 15:40:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-10-26 15:40:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-10-26 15:40:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-10-26 15:40:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-10-26 15:40:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-10-26 15:40:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-10-26 15:40:07 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-10-26 15:40:07 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-10-26 15:40:07 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-10-26 15:40:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-10-26 15:40:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-10-26 15:40:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-10-26 15:40:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-10-26 15:40:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-10-26 15:40:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-10-26 15:40:08 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-10-26 15:40:08 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-10-26 15:40:08 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-10-26 15:40:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-10-26 15:40:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-10-26 15:40:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-10-26 15:40:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-10-26 15:40:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-10-26 15:40:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-10-26 15:40:09 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-10-26 15:40:09 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-10-26 15:40:09 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-10-26 15:40:09 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-10-26 15:40:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-10-26 15:40:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-10-26 15:40:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-10-26 15:40:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-10-26 15:40:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-10-26 15:40:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-10-26 15:40:10 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-10-26 15:40:10 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-10-26 15:40:10 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-10-26 15:40:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-10-26 15:40:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-10-26 15:40:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-10-26 15:40:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-10-26 15:40:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-10-26 15:40:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-10-26 15:40:11 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-10-26 15:40:11 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-10-26 15:40:11 [INFO    ] Setting Beam 4 xbars
2018-10-26 15:40:11 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-10-26 15:40:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-26 15:40:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-26 15:40:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-26 15:40:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-26 15:40:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-10-26 15:40:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-10-26 15:40:12 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-10-26 15:40:12 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-10-26 15:40:12 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-10-26 15:40:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-10-26 15:40:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-10-26 15:40:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-10-26 15:40:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-10-26 15:40:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-10-26 15:40:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-10-26 15:40:13 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-10-26 15:40:13 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-10-26 15:40:13 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-10-26 15:40:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-10-26 15:40:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-10-26 15:40:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-10-26 15:40:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-10-26 15:40:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-10-26 15:40:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-10-26 15:40:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-10-26 15:40:14 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-10-26 15:40:14 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-10-26 15:40:14 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-10-26 15:40:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-10-26 15:40:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-10-26 15:40:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-10-26 15:40:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-10-26 15:40:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-10-26 15:40:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-10-26 15:40:15 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-10-26 15:40:15 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-10-26 15:40:15 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-10-26 15:40:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-10-26 15:40:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-10-26 15:40:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-10-26 15:40:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-10-26 15:40:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-10-26 15:40:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-10-26 15:40:16 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-10-26 15:40:16 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-10-26 15:40:16 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-10-26 15:40:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-10-26 15:40:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-10-26 15:40:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-10-26 15:40:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-10-26 15:40:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-10-26 15:40:16 [INFO    ] All xbars set
2018-10-26 15:40:16 [INFO    ] Setting adder chain routing for all beams
2018-10-26 15:40:21 [INFO    ] Setting beam ids
2018-10-26 15:40:31 [INFO    ] Starting beam delay calibration
2018-10-26 15:40:37 [DEBUG   ] Got command RPT from MCS: ref #278329
2018-10-26 15:40:37 [DEBUG   ] summary = BOOTING
2018-10-26 15:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278329  15 58417 56437433 ABOOTINGBOOTING'
2018-10-26 15:40:37 [DEBUG   ] Got command RPT from MCS: ref #278330
2018-10-26 15:40:37 [DEBUG   ] info = Starting calibration
2018-10-26 15:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278330  28 58417 56437434 ABOOTINGStarting calibration'
2018-10-26 15:40:43 [INFO    ] Beam 1 latency is 5728
2018-10-26 15:40:43 [INFO    ] Beam 2 latency is 5736
2018-10-26 15:40:43 [INFO    ] Beam 3 latency is 5723
2018-10-26 15:40:43 [INFO    ] Beam 4 latency is 5728
2018-10-26 15:40:43 [INFO    ] Stop calibration
2018-10-26 15:40:52 [INFO    ] Beam delay calibration successful
2018-10-26 15:40:52 [INFO    ] Calibration passed
2018-10-26 15:40:52 [DEBUG   ] spawn_process: at 2018-10-26 15:40:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-10-26 15:40:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-10-26 15:40:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-10-26 15:40:52 [DEBUG   ] spawn_process: at 2018-10-26 15:40:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-10-26 15:40:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-10-26 15:40:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-10-26 15:40:52 [DEBUG   ] spawn_process: at 2018-10-26 15:40:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-10-26 15:40:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-10-26 15:40:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-10-26 15:40:52 [DEBUG   ] spawn_process: at 2018-10-26 15:40:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-10-26 15:40:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-10-26 15:40:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-10-26 15:40:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-10-26 15:40:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 290 ms (1540568453.293 s) with PID 4234 and time 1540568454
2018-10-26 15:40:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-10-26 15:40:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 379 ms (1540568453.381 s) with PID 4237 and time 1540568454
2018-10-26 15:40:54 [DEBUG   ] Finished updating ant stats in 0.866 seconds
2018-10-26 15:40:54 [INFO    ] Started antennas statistics background thread
2018-10-26 15:40:54 [INFO    ] Started board flags background thread
2018-10-26 15:40:54 [INFO    ] Started BAM background thread
2018-10-26 15:40:54 [INFO    ] Finished the INI process (ref. #278328) in 108.960 s
2018-10-26 15:40:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:40:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:40:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:40:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:40:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:40:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:40:55 [DEBUG   ] Finished updating board flags in 1.048 seconds
2018-10-26 15:41:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:41:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:41:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:41:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:41:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:41:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:41:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:41:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:41:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:41:55 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-10-26 15:42:05 [DEBUG   ] Got command RPT from MCS: ref #278350
2018-10-26 15:42:05 [DEBUG   ] summary = ERROR
2018-10-26 15:42:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278350  13 58417 56525537 A  ERRORERROR'
2018-10-26 15:42:05 [DEBUG   ] Got command RPT from MCS: ref #278351
2018-10-26 15:42:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:42:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278351  77 58417 56525538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:42:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:42:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:42:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:42:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:42:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 15:42:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:42:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:42:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:42:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:42:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:42:55 [DEBUG   ] Finished updating board flags in 1.072 seconds
2018-10-26 15:43:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:43:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:43:37 [DEBUG   ] Got command RPT from MCS: ref #278354
2018-10-26 15:43:37 [DEBUG   ] summary = ERROR
2018-10-26 15:43:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278354  13 58417 56617413 A  ERRORERROR'
2018-10-26 15:43:37 [DEBUG   ] Got command RPT from MCS: ref #278355
2018-10-26 15:43:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:43:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278355  77 58417 56617617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:43:37 [DEBUG   ] Got command RPT from MCS: ref #278356
2018-10-26 15:43:37 [DEBUG   ] summary = ERROR
2018-10-26 15:43:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278356  13 58417 56617821 A  ERRORERROR'
2018-10-26 15:43:38 [DEBUG   ] Got command RPT from MCS: ref #278358
2018-10-26 15:43:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:43:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278358  77 58417 56618013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:43:38 [DEBUG   ] Got command RPT from MCS: ref #278359
2018-10-26 15:43:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 15:43:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278359  12 58417 56618217 A  ERRORB˜™š'
2018-10-26 15:43:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:43:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:43:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:43:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:43:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:43:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:43:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:43:56 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-10-26 15:44:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:44:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:44:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:44:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:44:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 15:44:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:44:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:44:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:44:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:44:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:44:56 [DEBUG   ] Finished updating board flags in 1.916 seconds
2018-10-26 15:45:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:45:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:45:37 [DEBUG   ] Got command RPT from MCS: ref #278368
2018-10-26 15:45:37 [DEBUG   ] summary = ERROR
2018-10-26 15:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278368  13 58417 56737441 A  ERRORERROR'
2018-10-26 15:45:37 [DEBUG   ] Got command RPT from MCS: ref #278369
2018-10-26 15:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278369  77 58417 56737442 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:45:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:45:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:45:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:45:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:45:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:45:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:45:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:45:55 [DEBUG   ] Finished updating board flags in 1.258 seconds
2018-10-26 15:46:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:46:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:46:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:46:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 15:46:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:46:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:46:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:46:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:46:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:46:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:46:56 [DEBUG   ] Finished updating board flags in 1.746 seconds
2018-10-26 15:47:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:47:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:47:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:47:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 15:47:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:47:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:47:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:47:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:47:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:47:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:47:55 [DEBUG   ] Finished updating board flags in 1.032 seconds
2018-10-26 15:48:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:48:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:48:37 [DEBUG   ] Got command RPT from MCS: ref #278389
2018-10-26 15:48:37 [DEBUG   ] summary = ERROR
2018-10-26 15:48:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278389  13 58417 56917497 A  ERRORERROR'
2018-10-26 15:48:37 [DEBUG   ] Got command RPT from MCS: ref #278390
2018-10-26 15:48:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:48:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278390  77 58417 56917701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:48:37 [DEBUG   ] Got command RPT from MCS: ref #278391
2018-10-26 15:48:37 [DEBUG   ] summary = ERROR
2018-10-26 15:48:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278391  13 58417 56917905 A  ERRORERROR'
2018-10-26 15:48:38 [DEBUG   ] Got command RPT from MCS: ref #278392
2018-10-26 15:48:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278392  77 58417 56918109 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:48:38 [DEBUG   ] Got command RPT from MCS: ref #278393
2018-10-26 15:48:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 15:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278393  12 58417 56918301 A  ERRORB˜™š'
2018-10-26 15:48:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:48:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:48:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:48:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:48:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:48:55 [WARNING ] (13, 1, 'bot')
2018-10-26 15:48:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:48:55 [DEBUG   ] Finished updating board flags in 1.053 seconds
2018-10-26 15:49:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:49:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:49:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:49:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 15:49:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:49:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:49:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:49:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:49:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:49:56 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-10-26 15:50:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:50:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:50:37 [DEBUG   ] Got command RPT from MCS: ref #278398
2018-10-26 15:50:37 [DEBUG   ] summary = ERROR
2018-10-26 15:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278398  13 58417 57037441 A  ERRORERROR'
2018-10-26 15:50:37 [DEBUG   ] Got command RPT from MCS: ref #278399
2018-10-26 15:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278399  77 58417 57037442 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:50:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:50:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:50:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:50:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:50:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:50:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:50:56 [DEBUG   ] Finished updating board flags in 1.311 seconds
2018-10-26 15:51:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:51:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:51:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:51:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:51:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:51:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:51:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:51:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:51:56 [DEBUG   ] Finished updating board flags in 1.223 seconds
2018-10-26 15:52:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:52:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 15:52:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 15:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:52:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:52:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:52:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:52:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:52:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:52:56 [DEBUG   ] Finished updating board flags in 1.198 seconds
2018-10-26 15:53:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 15:53:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 15:53:37 [DEBUG   ] Got command RPT from MCS: ref #278421
2018-10-26 15:53:37 [DEBUG   ] summary = ERROR
2018-10-26 15:53:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278421  13 58417 57217589 A  ERRORERROR'
2018-10-26 15:53:37 [DEBUG   ] Got command RPT from MCS: ref #278422
2018-10-26 15:53:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:53:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278422  77 58417 57217793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:53:37 [DEBUG   ] Got command RPT from MCS: ref #278423
2018-10-26 15:53:37 [DEBUG   ] summary = ERROR
2018-10-26 15:53:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278423  13 58417 57217985 A  ERRORERROR'
2018-10-26 15:53:38 [DEBUG   ] Got command RPT from MCS: ref #278424
2018-10-26 15:53:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:53:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278424  77 58417 57218189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:53:38 [DEBUG   ] Got command RPT from MCS: ref #278426
2018-10-26 15:53:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 15:53:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278426  12 58417 57218385 A  ERRORB˜™š'
2018-10-26 15:53:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 15:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:53:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:53:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:53:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:53:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:53:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:53:56 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-10-26 15:54:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 15:54:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 15:54:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 15:54:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 15:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:54:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:54:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:54:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:54:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:54:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:54:56 [DEBUG   ] Finished updating board flags in 0.980 seconds
2018-10-26 15:55:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 15:55:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 15:55:37 [DEBUG   ] Got command RPT from MCS: ref #278431
2018-10-26 15:55:37 [DEBUG   ] summary = ERROR
2018-10-26 15:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278431  13 58417 57337445 A  ERRORERROR'
2018-10-26 15:55:37 [DEBUG   ] Got command RPT from MCS: ref #278432
2018-10-26 15:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278432  77 58417 57337446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:55:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 15:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:55:57 [WARNING ] (13, 1, 'bot')
2018-10-26 15:55:57 [WARNING ] (13, 1, 'bot')
2018-10-26 15:55:57 [WARNING ] (13, 1, 'bot')
2018-10-26 15:55:57 [WARNING ] (13, 1, 'bot')
2018-10-26 15:55:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:55:57 [DEBUG   ] Finished updating board flags in 1.882 seconds
2018-10-26 15:56:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 15:56:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 15:56:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 15:56:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:56:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:56:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:56:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:56:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:56:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:56:56 [DEBUG   ] Finished updating board flags in 1.167 seconds
2018-10-26 15:57:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 15:57:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 15:57:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 15:57:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 15:57:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:57:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:57:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:57:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:57:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:57:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:57:56 [DEBUG   ] Finished updating board flags in 1.038 seconds
2018-10-26 15:58:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 15:58:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 15:58:37 [DEBUG   ] Got command RPT from MCS: ref #278452
2018-10-26 15:58:37 [DEBUG   ] summary = ERROR
2018-10-26 15:58:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278452  13 58417 57517677 A  ERRORERROR'
2018-10-26 15:58:37 [DEBUG   ] Got command RPT from MCS: ref #278453
2018-10-26 15:58:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:58:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278453  77 58417 57517869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:58:38 [DEBUG   ] Got command RPT from MCS: ref #278454
2018-10-26 15:58:38 [DEBUG   ] summary = ERROR
2018-10-26 15:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278454  13 58417 57518073 A  ERRORERROR'
2018-10-26 15:58:38 [DEBUG   ] Got command RPT from MCS: ref #278455
2018-10-26 15:58:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 15:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278455  77 58417 57518277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 15:58:38 [DEBUG   ] Got command RPT from MCS: ref #278456
2018-10-26 15:58:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 15:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278456  12 58417 57518481 A  ERRORB—™š'
2018-10-26 15:58:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 15:58:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:58:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:58:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:58:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:58:56 [WARNING ] (13, 1, 'bot')
2018-10-26 15:58:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:58:56 [DEBUG   ] Finished updating board flags in 0.973 seconds
2018-10-26 15:59:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 15:59:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 15:59:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 15:59:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 15:59:57 [WARNING ] (13, 1, 'bot')
2018-10-26 15:59:57 [WARNING ] (13, 1, 'bot')
2018-10-26 15:59:57 [WARNING ] (13, 1, 'bot')
2018-10-26 15:59:57 [WARNING ] (13, 1, 'bot')
2018-10-26 15:59:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 15:59:57 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-10-26 15:59:58 [DEBUG   ] Got command DRX from MCS: ref #278466
2018-10-26 15:59:58 [INFO    ] sending drx command to lwa16
2018-10-26 15:59:58 [DEBUG   ] run_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 49795000.0 7 9 0']
2018-10-26 15:59:58 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-26 15:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   278466   8 58417 57598006 A  ERROR'
2018-10-26 15:59:58 [DEBUG   ] Got command DRX from MCS: ref #278465
2018-10-26 15:59:58 [INFO    ] sending drx command to lwa16
2018-10-26 15:59:58 [DEBUG   ] run_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 49795000.0 7 9 0']
2018-10-26 15:59:58 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-26 15:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   278465   8 58417 57598010 A  ERROR'
2018-10-26 15:59:58 [DEBUG   ] Got command DRX from MCS: ref #278467
2018-10-26 15:59:58 [INFO    ] sending drx command to lwa16
2018-10-26 15:59:58 [DEBUG   ] run_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 74000000.0 7 9 0']
2018-10-26 15:59:58 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-26 15:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   278467   8 58417 57598014 A  ERROR'
2018-10-26 15:59:58 [DEBUG   ] Got command DRX from MCS: ref #278468
2018-10-26 15:59:58 [INFO    ] sending drx command to lwa16
2018-10-26 15:59:58 [DEBUG   ] run_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 74000000.0 7 9 0']
2018-10-26 15:59:58 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-26 15:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   278468   8 58417 57598018 A  ERROR'
2018-10-26 15:59:58 [DEBUG   ] Got command BAM from MCS: ref #278469
2018-10-26 15:59:58 [INFO    ] Finished processing BAM request
2018-10-26 15:59:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 15:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278469   8 58417 57598033 A  ERROR'
2018-10-26 15:59:58 [DEBUG   ] Got command BAM from MCS: ref #278470
2018-10-26 15:59:58 [INFO    ] Finished processing BAM request
2018-10-26 15:59:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 15:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278470   8 58417 57598037 A  ERROR'
2018-10-26 15:59:58 [INFO    ] Finished starting DRX
2018-10-26 15:59:58 [INFO    ] Finished starting DRX
2018-10-26 15:59:58 [INFO    ] Finished starting DRX
2018-10-26 15:59:58 [INFO    ] Finished starting DRX
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 15:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 15:59:58 [DEBUG   ] spawn_process: at 2018-10-26 15:59:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:00:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 16:00:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 16:00:37 [DEBUG   ] Got command RPT from MCS: ref #278473
2018-10-26 16:00:37 [DEBUG   ] summary = ERROR
2018-10-26 16:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278473  13 58417 57637441 A  ERRORERROR'
2018-10-26 16:00:37 [DEBUG   ] Got command RPT from MCS: ref #278474
2018-10-26 16:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278474  77 58417 57637442 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:00:54 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 16:00:55 [DEBUG   ] Got command BAM from MCS: ref #278490
2018-10-26 16:00:55 [INFO    ] Finished processing BAM request
2018-10-26 16:00:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:00:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278490   8 58417 57655025 A  ERROR'
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:00:55 [DEBUG   ] spawn_process: at 2018-10-26 16:00:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:00:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 16:00:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:00:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:00:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:00:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:00:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:00:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:00:57 [DEBUG   ] Finished updating board flags in 1.182 seconds
2018-10-26 16:00:59 [DEBUG   ] Got command BAM from MCS: ref #278491
2018-10-26 16:00:59 [INFO    ] Finished processing BAM request
2018-10-26 16:00:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:00:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278491   8 58417 57659025 A  ERROR'
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:00:59 [DEBUG   ] spawn_process: at 2018-10-26 16:00:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:01:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 16:01:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 16:01:52 [DEBUG   ] Got command BAM from MCS: ref #278492
2018-10-26 16:01:52 [INFO    ] Finished processing BAM request
2018-10-26 16:01:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:01:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278492   8 58417 57712025 A  ERROR'
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:01:52 [DEBUG   ] spawn_process: at 2018-10-26 16:01:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:01:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 16:01:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 16:01:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:01:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 16:01:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:01:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:01:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:01:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:01:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:01:57 [DEBUG   ] Finished updating board flags in 1.020 seconds
2018-10-26 16:01:59 [DEBUG   ] Got command BAM from MCS: ref #278497
2018-10-26 16:01:59 [INFO    ] Finished processing BAM request
2018-10-26 16:01:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:01:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278497   8 58417 57719025 A  ERROR'
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:01:59 [DEBUG   ] spawn_process: at 2018-10-26 16:01:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:02:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 16:02:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:02:49 [DEBUG   ] Got command BAM from MCS: ref #278498
2018-10-26 16:02:49 [INFO    ] Finished processing BAM request
2018-10-26 16:02:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:02:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278498   8 58417 57769025 A  ERROR'
2018-10-26 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:02:49 [DEBUG   ] spawn_process: at 2018-10-26 16:02:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:02:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:02:50 [DEBUG   ] spawn_process: at 2018-10-26 16:02:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:02:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:02:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 16:02:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:02:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 16:02:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:02:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 16:02:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:02:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:02:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:02:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:02:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:02:57 [DEBUG   ] Finished updating board flags in 1.064 seconds
2018-10-26 16:02:59 [DEBUG   ] Got command BAM from MCS: ref #278499
2018-10-26 16:02:59 [INFO    ] Finished processing BAM request
2018-10-26 16:02:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:02:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278499   8 58417 57779025 A  ERROR'
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:02:59 [DEBUG   ] spawn_process: at 2018-10-26 16:02:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:03:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 16:03:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 16:03:37 [DEBUG   ] Got command RPT from MCS: ref #278502
2018-10-26 16:03:37 [DEBUG   ] summary = ERROR
2018-10-26 16:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278502  13 58417 57817757 A  ERRORERROR'
2018-10-26 16:03:37 [DEBUG   ] Got command RPT from MCS: ref #278503
2018-10-26 16:03:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278503  77 58417 57817961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:03:38 [DEBUG   ] Got command RPT from MCS: ref #278504
2018-10-26 16:03:38 [DEBUG   ] summary = ERROR
2018-10-26 16:03:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278504  13 58417 57818165 A  ERRORERROR'
2018-10-26 16:03:38 [DEBUG   ] Got command RPT from MCS: ref #278505
2018-10-26 16:03:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:03:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278505  77 58417 57818357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:03:38 [DEBUG   ] Got command RPT from MCS: ref #278507
2018-10-26 16:03:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 16:03:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278507  12 58417 57818561 A  ERRORB ff'
2018-10-26 16:03:46 [DEBUG   ] Got command BAM from MCS: ref #278512
2018-10-26 16:03:46 [INFO    ] Finished processing BAM request
2018-10-26 16:03:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:03:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278512   8 58417 57826029 A  ERROR'
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:03:46 [DEBUG   ] spawn_process: at 2018-10-26 16:03:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:03:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:03:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:03:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:03:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:03:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:03:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:03:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:03:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:03:58 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-10-26 16:03:59 [DEBUG   ] Got command BAM from MCS: ref #278513
2018-10-26 16:03:59 [INFO    ] Finished processing BAM request
2018-10-26 16:03:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:03:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278513   8 58417 57839029 A  ERROR'
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:03:59 [DEBUG   ] spawn_process: at 2018-10-26 16:03:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:04:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 16:04:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 16:04:43 [DEBUG   ] Got command BAM from MCS: ref #278514
2018-10-26 16:04:43 [INFO    ] Finished processing BAM request
2018-10-26 16:04:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:04:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278514   8 58417 57883025 A  ERROR'
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:04:43 [DEBUG   ] spawn_process: at 2018-10-26 16:04:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:04:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 16:04:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 16:04:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:04:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:04:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:04:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:04:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:04:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:04:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:04:57 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-10-26 16:04:59 [DEBUG   ] Got command BAM from MCS: ref #278519
2018-10-26 16:04:59 [INFO    ] Finished processing BAM request
2018-10-26 16:04:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278519   8 58417 57899025 A  ERROR'
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:04:59 [DEBUG   ] spawn_process: at 2018-10-26 16:04:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:05:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:05:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:05:37 [DEBUG   ] Got command RPT from MCS: ref #278520
2018-10-26 16:05:37 [DEBUG   ] summary = ERROR
2018-10-26 16:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278520  13 58417 57937445 A  ERRORERROR'
2018-10-26 16:05:37 [DEBUG   ] Got command RPT from MCS: ref #278521
2018-10-26 16:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278521  77 58417 57937446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:05:39 [DEBUG   ] Got command BAM from MCS: ref #278537
2018-10-26 16:05:39 [INFO    ] Finished processing BAM request
2018-10-26 16:05:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278537   8 58417 57939033 A  ERROR'
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:05:39 [DEBUG   ] spawn_process: at 2018-10-26 16:05:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:05:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:05:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-26 16:05:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:05:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 16:05:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:05:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:05:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:05:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:05:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:05:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:05:57 [DEBUG   ] Finished updating board flags in 1.208 seconds
2018-10-26 16:05:58 [DEBUG   ] Got command BAM from MCS: ref #278538
2018-10-26 16:05:58 [INFO    ] Finished processing BAM request
2018-10-26 16:05:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278538   8 58417 57958025 A  ERROR'
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:05:58 [DEBUG   ] spawn_process: at 2018-10-26 16:05:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:06:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:06:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 16:06:35 [DEBUG   ] Got command BAM from MCS: ref #278539
2018-10-26 16:06:35 [INFO    ] Finished processing BAM request
2018-10-26 16:06:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:06:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278539   8 58417 57995025 A  ERROR'
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:06:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:06:35 [DEBUG   ] spawn_process: at 2018-10-26 16:06:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:06:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:06:57 [DEBUG   ] Got command BAM from MCS: ref #278540
2018-10-26 16:06:57 [INFO    ] Finished processing BAM request
2018-10-26 16:06:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:06:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278540   8 58417 58017025 A  ERROR'
2018-10-26 16:06:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-26 16:06:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:06:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:06:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 16:06:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:06:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:06:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:06:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:06:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:06:57 [DEBUG   ] Finished updating board flags in 1.184 seconds
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:06:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:06:57 [DEBUG   ] spawn_process: at 2018-10-26 16:06:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:07:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:07:31 [DEBUG   ] Got command BAM from MCS: ref #278541
2018-10-26 16:07:31 [INFO    ] Finished processing BAM request
2018-10-26 16:07:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:07:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278541   8 58417 58051025 A  ERROR'
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:07:31 [DEBUG   ] spawn_process: at 2018-10-26 16:07:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:07:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:07:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 16:07:56 [DEBUG   ] Got command BAM from MCS: ref #278545
2018-10-26 16:07:56 [INFO    ] Finished processing BAM request
2018-10-26 16:07:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:07:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278545   8 58417 58076033 A  ERROR'
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:07:56 [DEBUG   ] spawn_process: at 2018-10-26 16:07:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:07:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-26 16:07:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 16:07:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:07:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:07:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:07:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:07:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:07:57 [WARNING ] (13, 1, 'bot')
2018-10-26 16:07:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:07:57 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-10-26 16:08:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:08:27 [DEBUG   ] Got command BAM from MCS: ref #278547
2018-10-26 16:08:27 [INFO    ] Finished processing BAM request
2018-10-26 16:08:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278547   8 58417 58107029 A  ERROR'
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:08:27 [DEBUG   ] spawn_process: at 2018-10-26 16:08:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:08:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:08:37 [DEBUG   ] Got command RPT from MCS: ref #278548
2018-10-26 16:08:37 [DEBUG   ] summary = ERROR
2018-10-26 16:08:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278548  13 58417 58117845 A  ERRORERROR'
2018-10-26 16:08:38 [DEBUG   ] Got command RPT from MCS: ref #278549
2018-10-26 16:08:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278549  77 58417 58118049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:08:38 [DEBUG   ] Got command RPT from MCS: ref #278550
2018-10-26 16:08:38 [DEBUG   ] summary = ERROR
2018-10-26 16:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278550  13 58417 58118241 A  ERRORERROR'
2018-10-26 16:08:38 [DEBUG   ] Got command RPT from MCS: ref #278551
2018-10-26 16:08:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278551  77 58417 58118445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:08:38 [DEBUG   ] Got command RPT from MCS: ref #278552
2018-10-26 16:08:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 16:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278552  12 58417 58118649 A  ERRORB¢ff'
2018-10-26 16:08:54 [DEBUG   ] Got command BAM from MCS: ref #278553
2018-10-26 16:08:54 [INFO    ] Finished processing BAM request
2018-10-26 16:08:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:08:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278553   8 58417 58134029 A  ERROR'
2018-10-26 16:08:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:08:54 [DEBUG   ] spawn_process: at 2018-10-26 16:08:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:08:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:08:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:08:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:08:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:08:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:08:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:08:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:08:58 [DEBUG   ] Finished updating board flags in 1.552 seconds
2018-10-26 16:09:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:09:23 [DEBUG   ] Got command BAM from MCS: ref #278554
2018-10-26 16:09:23 [INFO    ] Finished processing BAM request
2018-10-26 16:09:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:09:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278554   8 58417 58163025 A  ERROR'
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:09:23 [DEBUG   ] spawn_process: at 2018-10-26 16:09:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:09:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:09:52 [DEBUG   ] Got command BAM from MCS: ref #278555
2018-10-26 16:09:52 [INFO    ] Finished processing BAM request
2018-10-26 16:09:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:09:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278555   8 58417 58192033 A  ERROR'
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:09:52 [DEBUG   ] spawn_process: at 2018-10-26 16:09:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:09:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 16:09:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 16:09:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:09:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-26 16:09:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:09:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 16:09:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:09:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:09:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:09:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:09:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:09:58 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-10-26 16:10:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 16:10:18 [DEBUG   ] Got command BAM from MCS: ref #278556
2018-10-26 16:10:18 [INFO    ] Finished processing BAM request
2018-10-26 16:10:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:10:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278556   8 58417 58218029 A  ERROR'
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:10:18 [DEBUG   ] spawn_process: at 2018-10-26 16:10:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:10:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 16:10:37 [DEBUG   ] Got command RPT from MCS: ref #278557
2018-10-26 16:10:37 [DEBUG   ] summary = ERROR
2018-10-26 16:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278557  13 58417 58237445 A  ERRORERROR'
2018-10-26 16:10:37 [DEBUG   ] Got command RPT from MCS: ref #278558
2018-10-26 16:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278558  77 58417 58237446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:10:50 [DEBUG   ] Got command BAM from MCS: ref #278574
2018-10-26 16:10:50 [INFO    ] Finished processing BAM request
2018-10-26 16:10:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:10:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278574   8 58417 58250029 A  ERROR'
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:10:50 [DEBUG   ] spawn_process: at 2018-10-26 16:10:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:10:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-26 16:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 16:10:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 16:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 16:10:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-26 16:10:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:10:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 16:10:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:10:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:10:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:10:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:10:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:10:58 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-10-26 16:11:13 [DEBUG   ] Got command BAM from MCS: ref #278579
2018-10-26 16:11:13 [INFO    ] Finished processing BAM request
2018-10-26 16:11:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:11:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278579   8 58417 58273033 A  ERROR'
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:11:13 [DEBUG   ] spawn_process: at 2018-10-26 16:11:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:11:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 16:11:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:11:48 [DEBUG   ] Got command BAM from MCS: ref #278580
2018-10-26 16:11:48 [INFO    ] Finished processing BAM request
2018-10-26 16:11:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:11:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278580   8 58417 58308025 A  ERROR'
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:11:48 [DEBUG   ] spawn_process: at 2018-10-26 16:11:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:11:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 16:11:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-26 16:11:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:11:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:11:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 16:11:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:11:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:11:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:11:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:11:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:11:58 [DEBUG   ] Finished updating board flags in 1.270 seconds
2018-10-26 16:12:08 [DEBUG   ] Got command BAM from MCS: ref #278581
2018-10-26 16:12:08 [INFO    ] Finished processing BAM request
2018-10-26 16:12:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:12:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278581   8 58417 58328029 A  ERROR'
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:12:08 [DEBUG   ] spawn_process: at 2018-10-26 16:12:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:12:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:12:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:12:45 [DEBUG   ] Got command BAM from MCS: ref #278582
2018-10-26 16:12:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:12:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278582   8 58417 58365033 A  ERROR'
2018-10-26 16:12:45 [INFO    ] Finished processing BAM request
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:12:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:12:45 [DEBUG   ] spawn_process: at 2018-10-26 16:12:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:12:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:12:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 16:12:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:12:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:12:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:12:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:12:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:12:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:12:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:12:58 [DEBUG   ] Finished updating board flags in 1.133 seconds
2018-10-26 16:13:03 [DEBUG   ] Got command BAM from MCS: ref #278583
2018-10-26 16:13:03 [INFO    ] Finished processing BAM request
2018-10-26 16:13:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:13:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278583   8 58417 58383025 A  ERROR'
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:13:03 [DEBUG   ] spawn_process: at 2018-10-26 16:13:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:13:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:13:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:13:37 [DEBUG   ] Got command RPT from MCS: ref #278586
2018-10-26 16:13:37 [DEBUG   ] summary = ERROR
2018-10-26 16:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278586  13 58417 58417925 A  ERRORERROR'
2018-10-26 16:13:38 [DEBUG   ] Got command RPT from MCS: ref #278587
2018-10-26 16:13:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:13:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278587  77 58417 58418129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:13:38 [DEBUG   ] Got command RPT from MCS: ref #278588
2018-10-26 16:13:38 [DEBUG   ] summary = ERROR
2018-10-26 16:13:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278588  13 58417 58418333 A  ERRORERROR'
2018-10-26 16:13:38 [DEBUG   ] Got command RPT from MCS: ref #278590
2018-10-26 16:13:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:13:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278590  77 58417 58418537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:13:38 [DEBUG   ] Got command RPT from MCS: ref #278591
2018-10-26 16:13:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 16:13:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278591  12 58417 58418729 A  ERRORB£ff'
2018-10-26 16:13:42 [DEBUG   ] Got command BAM from MCS: ref #278596
2018-10-26 16:13:42 [INFO    ] Finished processing BAM request
2018-10-26 16:13:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:13:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278596   8 58417 58422033 A  ERROR'
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:13:42 [DEBUG   ] spawn_process: at 2018-10-26 16:13:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:13:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:13:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-26 16:13:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 16:13:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:13:58 [DEBUG   ] Got command BAM from MCS: ref #278601
2018-10-26 16:13:58 [INFO    ] Finished processing BAM request
2018-10-26 16:13:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:13:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278601   8 58417 58438025 A  ERROR'
2018-10-26 16:13:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:13:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 16:13:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:13:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:13:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:13:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:13:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:13:58 [DEBUG   ] Finished updating board flags in 1.019 seconds
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:13:58 [DEBUG   ] spawn_process: at 2018-10-26 16:13:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:14:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:14:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 16:14:39 [DEBUG   ] Got command BAM from MCS: ref #278602
2018-10-26 16:14:39 [INFO    ] Finished processing BAM request
2018-10-26 16:14:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:14:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278602   8 58417 58479033 A  ERROR'
2018-10-26 16:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:14:39 [DEBUG   ] spawn_process: at 2018-10-26 16:14:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:14:40 [DEBUG   ] spawn_process: at 2018-10-26 16:14:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:14:52 [DEBUG   ] Got command BAM from MCS: ref #278603
2018-10-26 16:14:52 [INFO    ] Finished processing BAM request
2018-10-26 16:14:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278603   8 58417 58492033 A  ERROR'
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:14:52 [DEBUG   ] spawn_process: at 2018-10-26 16:14:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:14:54 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-26 16:14:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-26 16:14:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 16:14:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:14:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:14:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 16:14:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:14:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:14:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:14:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:14:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:14:58 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-10-26 16:15:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 16:15:35 [DEBUG   ] Got command BAM from MCS: ref #278604
2018-10-26 16:15:35 [INFO    ] Finished processing BAM request
2018-10-26 16:15:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:15:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278604   8 58417 58535033 A  ERROR'
2018-10-26 16:15:35 [DEBUG   ] Finished updating ant stats in 1.178 seconds
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:15:35 [DEBUG   ] spawn_process: at 2018-10-26 16:15:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:15:37 [DEBUG   ] Got command RPT from MCS: ref #278605
2018-10-26 16:15:37 [DEBUG   ] summary = ERROR
2018-10-26 16:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278605  13 58417 58537445 A  ERRORERROR'
2018-10-26 16:15:37 [DEBUG   ] Got command RPT from MCS: ref #278606
2018-10-26 16:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278606  77 58417 58537446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:15:46 [DEBUG   ] Got command BAM from MCS: ref #278622
2018-10-26 16:15:46 [INFO    ] Finished processing BAM request
2018-10-26 16:15:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:15:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278622   8 58417 58546029 A  ERROR'
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:15:46 [DEBUG   ] spawn_process: at 2018-10-26 16:15:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:15:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 16:15:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:15:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:15:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:15:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:15:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:15:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:15:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:15:58 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-10-26 16:16:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 16:16:31 [DEBUG   ] Got command BAM from MCS: ref #278623
2018-10-26 16:16:31 [INFO    ] Finished processing BAM request
2018-10-26 16:16:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:16:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278623   8 58417 58591033 A  ERROR'
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:16:31 [DEBUG   ] spawn_process: at 2018-10-26 16:16:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:16:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 16:16:40 [DEBUG   ] Got command BAM from MCS: ref #278624
2018-10-26 16:16:40 [INFO    ] Finished processing BAM request
2018-10-26 16:16:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278624   8 58417 58600025 A  ERROR'
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:16:40 [DEBUG   ] spawn_process: at 2018-10-26 16:16:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:16:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 16:16:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:16:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 16:16:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 16:16:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:16:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:16:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:16:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:16:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:16:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:16:59 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-10-26 16:17:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 16:17:27 [DEBUG   ] Got command BAM from MCS: ref #278629
2018-10-26 16:17:27 [INFO    ] Finished processing BAM request
2018-10-26 16:17:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:17:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278629   8 58417 58647029 A  ERROR'
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:17:27 [DEBUG   ] spawn_process: at 2018-10-26 16:17:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:17:34 [DEBUG   ] Got command BAM from MCS: ref #278630
2018-10-26 16:17:34 [INFO    ] Finished processing BAM request
2018-10-26 16:17:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:17:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278630   8 58417 58654025 A  ERROR'
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:17:34 [DEBUG   ] spawn_process: at 2018-10-26 16:17:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:17:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 16:17:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:17:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 16:17:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:17:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:17:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 16:17:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:17:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:17:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:17:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:17:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:17:58 [DEBUG   ] Finished updating board flags in 1.220 seconds
2018-10-26 16:18:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:18:23 [DEBUG   ] Got command BAM from MCS: ref #278631
2018-10-26 16:18:23 [INFO    ] Finished processing BAM request
2018-10-26 16:18:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278631   8 58417 58703029 A  ERROR'
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:18:23 [DEBUG   ] spawn_process: at 2018-10-26 16:18:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:18:28 [DEBUG   ] Got command BAM from MCS: ref #278632
2018-10-26 16:18:28 [INFO    ] Finished processing BAM request
2018-10-26 16:18:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278632   8 58417 58708029 A  ERROR'
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:18:28 [DEBUG   ] spawn_process: at 2018-10-26 16:18:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:18:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:18:38 [DEBUG   ] Got command RPT from MCS: ref #278633
2018-10-26 16:18:38 [DEBUG   ] summary = ERROR
2018-10-26 16:18:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278633  13 58417 58718009 A  ERRORERROR'
2018-10-26 16:18:38 [DEBUG   ] Got command RPT from MCS: ref #278634
2018-10-26 16:18:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:18:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278634  77 58417 58718213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:18:38 [DEBUG   ] Got command RPT from MCS: ref #278635
2018-10-26 16:18:38 [DEBUG   ] summary = ERROR
2018-10-26 16:18:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278635  13 58417 58718417 A  ERRORERROR'
2018-10-26 16:18:38 [DEBUG   ] Got command RPT from MCS: ref #278636
2018-10-26 16:18:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:18:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278636  77 58417 58718621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:18:38 [DEBUG   ] Got command RPT from MCS: ref #278637
2018-10-26 16:18:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 16:18:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278637  12 58417 58718813 A  ERRORB£ff'
2018-10-26 16:18:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:18:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 16:18:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:18:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2018-10-26 16:18:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:18:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 16:18:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:18:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:18:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:18:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:18:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:18:58 [DEBUG   ] Finished updating board flags in 1.225 seconds
2018-10-26 16:19:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:19:18 [DEBUG   ] Got command BAM from MCS: ref #278638
2018-10-26 16:19:18 [INFO    ] Finished processing BAM request
2018-10-26 16:19:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:19:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278638   8 58417 58758029 A  ERROR'
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:19:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:19:18 [DEBUG   ] spawn_process: at 2018-10-26 16:19:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:19:22 [DEBUG   ] Got command BAM from MCS: ref #278639
2018-10-26 16:19:22 [INFO    ] Finished processing BAM request
2018-10-26 16:19:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:19:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278639   8 58417 58762033 A  ERROR'
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:19:22 [DEBUG   ] spawn_process: at 2018-10-26 16:19:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:19:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:19:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:19:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 16:19:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:19:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:19:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:19:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:19:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:19:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:19:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:19:58 [DEBUG   ] Finished updating board flags in 1.199 seconds
2018-10-26 16:20:13 [DEBUG   ] Got command BAM from MCS: ref #278644
2018-10-26 16:20:13 [INFO    ] Finished processing BAM request
2018-10-26 16:20:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:20:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278644   8 58417 58813033 A  ERROR'
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:20:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:20:13 [DEBUG   ] spawn_process: at 2018-10-26 16:20:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:20:15 [DEBUG   ] Got command BAM from MCS: ref #278645
2018-10-26 16:20:15 [INFO    ] Finished processing BAM request
2018-10-26 16:20:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:20:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278645   8 58417 58815025 A  ERROR'
2018-10-26 16:20:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:20:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:20:15 [DEBUG   ] spawn_process: at 2018-10-26 16:20:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:20:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 16:20:37 [DEBUG   ] Got command RPT from MCS: ref #278646
2018-10-26 16:20:37 [DEBUG   ] summary = ERROR
2018-10-26 16:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278646  13 58417 58837441 A  ERRORERROR'
2018-10-26 16:20:37 [DEBUG   ] Got command RPT from MCS: ref #278647
2018-10-26 16:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278647  77 58417 58837442 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:20:55 [DEBUG   ] Finished updating ant stats in 0.782 seconds
2018-10-26 16:20:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 16:20:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:20:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-26 16:20:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:20:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:20:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:20:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:20:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:20:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:20:58 [DEBUG   ] Finished updating board flags in 1.026 seconds
2018-10-26 16:21:08 [DEBUG   ] Got command BAM from MCS: ref #278663
2018-10-26 16:21:08 [INFO    ] Finished processing BAM request
2018-10-26 16:21:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:21:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278663   8 58417 58868029 A  ERROR'
2018-10-26 16:21:08 [DEBUG   ] Got command BAM from MCS: ref #278664
2018-10-26 16:21:08 [INFO    ] Finished processing BAM request
2018-10-26 16:21:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:21:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278664   8 58417 58868033 A  ERROR'
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:21:08 [DEBUG   ] spawn_process: at 2018-10-26 16:21:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:21:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 16:21:35 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-10-26 16:21:55 [DEBUG   ] Finished updating ant stats in 0.394 seconds
2018-10-26 16:21:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 16:21:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 16:21:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:21:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:21:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:21:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:21:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:21:58 [WARNING ] (13, 1, 'bot')
2018-10-26 16:21:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:21:58 [DEBUG   ] Finished updating board flags in 0.961 seconds
2018-10-26 16:22:01 [DEBUG   ] Got command BAM from MCS: ref #278665
2018-10-26 16:22:01 [INFO    ] Finished processing BAM request
2018-10-26 16:22:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278665   8 58417 58921033 A  ERROR'
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:22:01 [DEBUG   ] spawn_process: at 2018-10-26 16:22:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:22:03 [DEBUG   ] Got command BAM from MCS: ref #278666
2018-10-26 16:22:03 [INFO    ] Finished processing BAM request
2018-10-26 16:22:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:22:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278666   8 58417 58923029 A  ERROR'
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:22:03 [DEBUG   ] spawn_process: at 2018-10-26 16:22:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:22:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 16:22:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 16:22:54 [DEBUG   ] Got command BAM from MCS: ref #278667
2018-10-26 16:22:54 [INFO    ] Finished processing BAM request
2018-10-26 16:22:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:22:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278667   8 58417 58974029 A  ERROR'
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:22:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:22:54 [DEBUG   ] spawn_process: at 2018-10-26 16:22:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:22:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 16:22:57 [DEBUG   ] Got command BAM from MCS: ref #278672
2018-10-26 16:22:57 [INFO    ] Finished processing BAM request
2018-10-26 16:22:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:22:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278672   8 58417 58977033 A  ERROR'
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:22:57 [DEBUG   ] spawn_process: at 2018-10-26 16:22:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:22:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-26 16:22:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 16:22:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:22:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-26 16:22:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:22:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:22:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:22:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:22:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:22:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:22:59 [DEBUG   ] Finished updating board flags in 1.367 seconds
2018-10-26 16:23:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 16:23:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 16:23:38 [DEBUG   ] Got command RPT from MCS: ref #278675
2018-10-26 16:23:38 [DEBUG   ] summary = ERROR
2018-10-26 16:23:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278675  13 58417 59018093 A  ERRORERROR'
2018-10-26 16:23:38 [DEBUG   ] Got command RPT from MCS: ref #278676
2018-10-26 16:23:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:23:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278676  77 58417 59018297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:23:38 [DEBUG   ] Got command RPT from MCS: ref #278677
2018-10-26 16:23:38 [DEBUG   ] summary = ERROR
2018-10-26 16:23:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278677  13 58417 59018501 A  ERRORERROR'
2018-10-26 16:23:38 [DEBUG   ] Got command RPT from MCS: ref #278679
2018-10-26 16:23:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:23:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278679  77 58417 59018705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:23:38 [DEBUG   ] Got command RPT from MCS: ref #278681
2018-10-26 16:23:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 16:23:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278681  12 58417 59018897 A  ERRORB¢ff'
2018-10-26 16:23:47 [DEBUG   ] Got command BAM from MCS: ref #278685
2018-10-26 16:23:47 [INFO    ] Finished processing BAM request
2018-10-26 16:23:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:23:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278685   8 58417 59027025 A  ERROR'
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:23:47 [DEBUG   ] spawn_process: at 2018-10-26 16:23:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:23:51 [DEBUG   ] Got command BAM from MCS: ref #278686
2018-10-26 16:23:51 [INFO    ] Finished processing BAM request
2018-10-26 16:23:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:23:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278686   8 58417 59031025 A  ERROR'
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:23:51 [DEBUG   ] spawn_process: at 2018-10-26 16:23:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:23:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 16:23:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:23:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 16:23:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-26 16:23:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:23:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 16:23:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 16:23:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:23:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:23:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:23:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:23:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:23:59 [DEBUG   ] Finished updating board flags in 1.200 seconds
2018-10-26 16:24:16 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 16:24:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 16:24:40 [DEBUG   ] Got command BAM from MCS: ref #278687
2018-10-26 16:24:40 [INFO    ] Finished processing BAM request
2018-10-26 16:24:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:24:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278687   8 58417 59080025 A  ERROR'
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:24:40 [DEBUG   ] spawn_process: at 2018-10-26 16:24:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:24:45 [DEBUG   ] Got command BAM from MCS: ref #278688
2018-10-26 16:24:45 [INFO    ] Finished processing BAM request
2018-10-26 16:24:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:24:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278688   8 58417 59085033 A  ERROR'
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:24:45 [DEBUG   ] spawn_process: at 2018-10-26 16:24:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:24:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 16:24:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:24:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:24:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:24:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:24:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:24:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:24:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:24:59 [DEBUG   ] Finished updating board flags in 1.002 seconds
2018-10-26 16:25:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 16:25:32 [DEBUG   ] Got command BAM from MCS: ref #278689
2018-10-26 16:25:32 [INFO    ] Finished processing BAM request
2018-10-26 16:25:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:25:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278689   8 58417 59132029 A  ERROR'
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:25:32 [DEBUG   ] spawn_process: at 2018-10-26 16:25:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:25:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 16:25:37 [DEBUG   ] Got command RPT from MCS: ref #278690
2018-10-26 16:25:37 [DEBUG   ] summary = ERROR
2018-10-26 16:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278690  13 58417 59137453 A  ERRORERROR'
2018-10-26 16:25:37 [DEBUG   ] Got command RPT from MCS: ref #278691
2018-10-26 16:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278691  77 58417 59137454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:25:39 [DEBUG   ] Got command BAM from MCS: ref #278707
2018-10-26 16:25:39 [INFO    ] Finished processing BAM request
2018-10-26 16:25:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278707   8 58417 59139029 A  ERROR'
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:25:39 [DEBUG   ] spawn_process: at 2018-10-26 16:25:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:25:56 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 16:25:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:25:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:25:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:25:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:25:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:25:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:25:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:25:59 [DEBUG   ] Finished updating board flags in 1.059 seconds
2018-10-26 16:26:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:26:24 [DEBUG   ] Got command BAM from MCS: ref #278712
2018-10-26 16:26:24 [INFO    ] Finished processing BAM request
2018-10-26 16:26:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:26:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278712   8 58417 59184025 A  ERROR'
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:26:24 [DEBUG   ] spawn_process: at 2018-10-26 16:26:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:26:32 [DEBUG   ] Got command BAM from MCS: ref #278713
2018-10-26 16:26:32 [INFO    ] Finished processing BAM request
2018-10-26 16:26:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:26:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278713   8 58417 59192033 A  ERROR'
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:26:32 [DEBUG   ] spawn_process: at 2018-10-26 16:26:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:26:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:26:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:26:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:26:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:26:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 16:26:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 16:26:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:26:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:26:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:26:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:26:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:26:59 [DEBUG   ] Finished updating board flags in 1.472 seconds
2018-10-26 16:27:16 [DEBUG   ] Got command BAM from MCS: ref #278714
2018-10-26 16:27:16 [INFO    ] Finished processing BAM request
2018-10-26 16:27:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:27:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278714   8 58417 59236029 A  ERROR'
2018-10-26 16:27:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:27:16 [DEBUG   ] spawn_process: at 2018-10-26 16:27:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:27:25 [DEBUG   ] Got command BAM from MCS: ref #278715
2018-10-26 16:27:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:27:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278715   8 58417 59245029 A  ERROR'
2018-10-26 16:27:25 [INFO    ] Finished processing BAM request
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:27:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:27:25 [DEBUG   ] spawn_process: at 2018-10-26 16:27:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:27:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:27:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:27:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2018-10-26 16:27:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 16:27:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:28:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-26 16:28:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:28:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 16:28:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:28:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:28:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:28:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:28:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:28:00 [DEBUG   ] Finished updating board flags in 1.951 seconds
2018-10-26 16:28:08 [DEBUG   ] Got command BAM from MCS: ref #278716
2018-10-26 16:28:08 [INFO    ] Finished processing BAM request
2018-10-26 16:28:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:28:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278716   8 58417 59288025 A  ERROR'
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:28:08 [DEBUG   ] spawn_process: at 2018-10-26 16:28:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:28:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:28:18 [DEBUG   ] Got command BAM from MCS: ref #278717
2018-10-26 16:28:18 [INFO    ] Finished processing BAM request
2018-10-26 16:28:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278717   8 58417 59298029 A  ERROR'
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:28:18 [DEBUG   ] spawn_process: at 2018-10-26 16:28:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:28:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:28:38 [DEBUG   ] Got command RPT from MCS: ref #278718
2018-10-26 16:28:38 [DEBUG   ] summary = ERROR
2018-10-26 16:28:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278718  13 58417 59318185 A  ERRORERROR'
2018-10-26 16:28:38 [DEBUG   ] Got command RPT from MCS: ref #278719
2018-10-26 16:28:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:28:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278719  77 58417 59318377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:28:38 [DEBUG   ] Got command RPT from MCS: ref #278720
2018-10-26 16:28:38 [DEBUG   ] summary = ERROR
2018-10-26 16:28:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278720  13 58417 59318581 A  ERRORERROR'
2018-10-26 16:28:38 [DEBUG   ] Got command RPT from MCS: ref #278721
2018-10-26 16:28:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:28:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278721  77 58417 59318785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:28:38 [DEBUG   ] Got command RPT from MCS: ref #278722
2018-10-26 16:28:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 16:28:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278722  12 58417 59318981 A  ERRORB¢ff'
2018-10-26 16:28:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 16:28:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:28:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:28:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:28:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:28:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:28:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:28:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:28:59 [DEBUG   ] Finished updating board flags in 1.173 seconds
2018-10-26 16:29:00 [DEBUG   ] Got command BAM from MCS: ref #278727
2018-10-26 16:29:00 [INFO    ] Finished processing BAM request
2018-10-26 16:29:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:29:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278727   8 58417 59340025 A  ERROR'
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:29:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:29:00 [DEBUG   ] spawn_process: at 2018-10-26 16:29:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:29:11 [DEBUG   ] Got command BAM from MCS: ref #278728
2018-10-26 16:29:11 [INFO    ] Finished processing BAM request
2018-10-26 16:29:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:29:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278728   8 58417 59351025 A  ERROR'
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:29:11 [DEBUG   ] spawn_process: at 2018-10-26 16:29:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:29:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:29:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:29:52 [DEBUG   ] Got command BAM from MCS: ref #278729
2018-10-26 16:29:52 [INFO    ] Finished processing BAM request
2018-10-26 16:29:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:29:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278729   8 58417 59392033 A  ERROR'
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:29:52 [DEBUG   ] spawn_process: at 2018-10-26 16:29:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:29:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 16:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 16:29:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:29:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:29:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:29:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:29:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:29:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:29:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:29:59 [DEBUG   ] Finished updating board flags in 1.019 seconds
2018-10-26 16:30:03 [DEBUG   ] Got command BAM from MCS: ref #278730
2018-10-26 16:30:03 [INFO    ] Finished processing BAM request
2018-10-26 16:30:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278730   8 58417 59403025 A  ERROR'
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:30:03 [DEBUG   ] spawn_process: at 2018-10-26 16:30:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:30:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 16:30:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 16:30:37 [DEBUG   ] Got command RPT from MCS: ref #278731
2018-10-26 16:30:37 [DEBUG   ] summary = ERROR
2018-10-26 16:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278731  13 58417 59437449 A  ERRORERROR'
2018-10-26 16:30:37 [DEBUG   ] Got command RPT from MCS: ref #278732
2018-10-26 16:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278732  77 58417 59437450 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:30:43 [DEBUG   ] Got command BAM from MCS: ref #278748
2018-10-26 16:30:43 [INFO    ] Finished processing BAM request
2018-10-26 16:30:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:30:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278748   8 58417 59443025 A  ERROR'
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:30:43 [DEBUG   ] spawn_process: at 2018-10-26 16:30:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:30:55 [DEBUG   ] Got command BAM from MCS: ref #278749
2018-10-26 16:30:55 [INFO    ] Finished processing BAM request
2018-10-26 16:30:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:30:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278749   8 58417 59455029 A  ERROR'
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:30:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:30:55 [DEBUG   ] spawn_process: at 2018-10-26 16:30:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:30:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 16:30:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:30:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:30:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:30:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:30:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:30:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:30:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:30:59 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-10-26 16:31:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 16:31:34 [DEBUG   ] Got command BAM from MCS: ref #278750
2018-10-26 16:31:34 [INFO    ] Finished processing BAM request
2018-10-26 16:31:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:31:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278750   8 58417 59494033 A  ERROR'
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:31:34 [DEBUG   ] spawn_process: at 2018-10-26 16:31:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:31:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 16:31:47 [DEBUG   ] Got command BAM from MCS: ref #278751
2018-10-26 16:31:47 [INFO    ] Finished processing BAM request
2018-10-26 16:31:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:31:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278751   8 58417 59507033 A  ERROR'
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:31:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:31:47 [DEBUG   ] spawn_process: at 2018-10-26 16:31:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:31:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 16:31:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 16:31:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:31:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-26 16:31:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 16:31:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-26 16:31:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:31:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:31:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:31:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:31:59 [WARNING ] (13, 1, 'bot')
2018-10-26 16:31:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:31:59 [DEBUG   ] Finished updating board flags in 0.961 seconds
2018-10-26 16:32:16 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 16:32:25 [DEBUG   ] Got command BAM from MCS: ref #278756
2018-10-26 16:32:25 [INFO    ] Finished processing BAM request
2018-10-26 16:32:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:32:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278756   8 58417 59545033 A  ERROR'
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:32:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:32:25 [DEBUG   ] spawn_process: at 2018-10-26 16:32:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:32:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:32:39 [DEBUG   ] Got command BAM from MCS: ref #278757
2018-10-26 16:32:39 [INFO    ] Finished processing BAM request
2018-10-26 16:32:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:32:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278757   8 58417 59559026 A  ERROR'
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:32:39 [DEBUG   ] spawn_process: at 2018-10-26 16:32:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:32:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:32:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 16:32:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:33:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-26 16:33:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:33:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:33:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:33:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:33:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:33:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:33:00 [DEBUG   ] Finished updating board flags in 1.461 seconds
2018-10-26 16:33:16 [DEBUG   ] Got command BAM from MCS: ref #278760
2018-10-26 16:33:16 [INFO    ] Finished processing BAM request
2018-10-26 16:33:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278760   8 58417 59596025 A  ERROR'
2018-10-26 16:33:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:33:16 [DEBUG   ] spawn_process: at 2018-10-26 16:33:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:33:30 [DEBUG   ] Got command BAM from MCS: ref #278761
2018-10-26 16:33:30 [INFO    ] Finished processing BAM request
2018-10-26 16:33:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278761   8 58417 59610033 A  ERROR'
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:33:30 [DEBUG   ] spawn_process: at 2018-10-26 16:33:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:33:36 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-26 16:33:38 [DEBUG   ] Got command RPT from MCS: ref #278762
2018-10-26 16:33:38 [DEBUG   ] summary = ERROR
2018-10-26 16:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278762  13 58417 59618265 A  ERRORERROR'
2018-10-26 16:33:38 [DEBUG   ] Got command RPT from MCS: ref #278763
2018-10-26 16:33:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278763  77 58417 59618469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:33:38 [DEBUG   ] Got command RPT from MCS: ref #278764
2018-10-26 16:33:38 [DEBUG   ] summary = ERROR
2018-10-26 16:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278764  13 58417 59618673 A  ERRORERROR'
2018-10-26 16:33:38 [DEBUG   ] Got command RPT from MCS: ref #278766
2018-10-26 16:33:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278766  77 58417 59618865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:33:39 [DEBUG   ] Got command RPT from MCS: ref #278767
2018-10-26 16:33:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 16:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278767  12 58417 59619069 A  ERRORB¢ff'
2018-10-26 16:33:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 16:33:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:34:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:34:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:34:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:34:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:34:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:34:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:34:00 [DEBUG   ] Finished updating board flags in 1.311 seconds
2018-10-26 16:34:07 [DEBUG   ] Got command BAM from MCS: ref #278772
2018-10-26 16:34:07 [INFO    ] Finished processing BAM request
2018-10-26 16:34:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:34:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278772   8 58417 59647025 A  ERROR'
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:34:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:34:07 [DEBUG   ] spawn_process: at 2018-10-26 16:34:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:34:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 16:34:21 [DEBUG   ] Got command BAM from MCS: ref #278773
2018-10-26 16:34:21 [INFO    ] Finished processing BAM request
2018-10-26 16:34:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:34:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278773   8 58417 59661033 A  ERROR'
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:34:21 [DEBUG   ] spawn_process: at 2018-10-26 16:34:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:34:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 16:34:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 16:34:58 [DEBUG   ] Got command BAM from MCS: ref #278778
2018-10-26 16:34:58 [INFO    ] Finished processing BAM request
2018-10-26 16:34:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278778   8 58417 59698025 A  ERROR'
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:34:58 [DEBUG   ] spawn_process: at 2018-10-26 16:34:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:34:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 16:34:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:35:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:35:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:35:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:35:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:35:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:35:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:35:00 [DEBUG   ] Finished updating board flags in 1.201 seconds
2018-10-26 16:35:12 [DEBUG   ] Got command BAM from MCS: ref #278779
2018-10-26 16:35:12 [INFO    ] Finished processing BAM request
2018-10-26 16:35:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278779   8 58417 59712029 A  ERROR'
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:35:12 [DEBUG   ] spawn_process: at 2018-10-26 16:35:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:35:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 16:35:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:35:37 [DEBUG   ] Got command RPT from MCS: ref #278780
2018-10-26 16:35:37 [DEBUG   ] summary = ERROR
2018-10-26 16:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278780  13 58417 59737453 A  ERRORERROR'
2018-10-26 16:35:37 [DEBUG   ] Got command RPT from MCS: ref #278781
2018-10-26 16:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278781  77 58417 59737454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:35:48 [DEBUG   ] Got command BAM from MCS: ref #278797
2018-10-26 16:35:48 [INFO    ] Finished processing BAM request
2018-10-26 16:35:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278797   8 58417 59748029 A  ERROR'
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:35:48 [DEBUG   ] spawn_process: at 2018-10-26 16:35:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:35:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:35:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 16:35:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:36:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:36:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:36:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:36:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:36:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:36:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:36:00 [DEBUG   ] Finished updating board flags in 1.207 seconds
2018-10-26 16:36:03 [DEBUG   ] Got command BAM from MCS: ref #278798
2018-10-26 16:36:03 [INFO    ] Finished processing BAM request
2018-10-26 16:36:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:36:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278798   8 58417 59763029 A  ERROR'
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:36:03 [DEBUG   ] spawn_process: at 2018-10-26 16:36:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:36:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 16:36:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 16:36:38 [DEBUG   ] Got command BAM from MCS: ref #278799
2018-10-26 16:36:38 [INFO    ] Finished processing BAM request
2018-10-26 16:36:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278799   8 58417 59798025 A  ERROR'
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:36:38 [DEBUG   ] spawn_process: at 2018-10-26 16:36:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:36:53 [DEBUG   ] Got command BAM from MCS: ref #278800
2018-10-26 16:36:53 [INFO    ] Finished processing BAM request
2018-10-26 16:36:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:36:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278800   8 58417 59813029 A  ERROR'
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:36:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:36:53 [DEBUG   ] spawn_process: at 2018-10-26 16:36:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:36:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 16:36:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 16:36:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:37:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:37:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:37:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:37:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:37:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:37:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:37:00 [DEBUG   ] Finished updating board flags in 1.193 seconds
2018-10-26 16:37:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 16:37:28 [DEBUG   ] Got command BAM from MCS: ref #278801
2018-10-26 16:37:28 [INFO    ] Finished processing BAM request
2018-10-26 16:37:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:37:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278801   8 58417 59848029 A  ERROR'
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:37:28 [DEBUG   ] spawn_process: at 2018-10-26 16:37:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:37:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 16:37:43 [DEBUG   ] Got command BAM from MCS: ref #278802
2018-10-26 16:37:43 [INFO    ] Finished processing BAM request
2018-10-26 16:37:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278802   8 58417 59863029 A  ERROR'
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:37:43 [DEBUG   ] spawn_process: at 2018-10-26 16:37:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:37:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 16:37:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 16:37:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:38:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:38:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:38:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:38:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:38:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:38:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:38:00 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-10-26 16:38:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 16:38:18 [DEBUG   ] Got command BAM from MCS: ref #278807
2018-10-26 16:38:18 [INFO    ] Finished processing BAM request
2018-10-26 16:38:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278807   8 58417 59898025 A  ERROR'
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:38:18 [DEBUG   ] spawn_process: at 2018-10-26 16:38:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:38:33 [DEBUG   ] Got command BAM from MCS: ref #278808
2018-10-26 16:38:33 [INFO    ] Finished processing BAM request
2018-10-26 16:38:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278808   8 58417 59913029 A  ERROR'
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:38:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:38:33 [DEBUG   ] spawn_process: at 2018-10-26 16:38:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:38:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:38:38 [DEBUG   ] Got command RPT from MCS: ref #278809
2018-10-26 16:38:38 [DEBUG   ] summary = ERROR
2018-10-26 16:38:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278809  13 58417 59918349 A  ERRORERROR'
2018-10-26 16:38:38 [DEBUG   ] Got command RPT from MCS: ref #278810
2018-10-26 16:38:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:38:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278810  77 58417 59918553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:38:38 [DEBUG   ] Got command RPT from MCS: ref #278811
2018-10-26 16:38:38 [DEBUG   ] summary = ERROR
2018-10-26 16:38:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278811  13 58417 59918757 A  ERRORERROR'
2018-10-26 16:38:38 [DEBUG   ] Got command RPT from MCS: ref #278812
2018-10-26 16:38:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:38:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278812  77 58417 59918961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:38:39 [DEBUG   ] Got command RPT from MCS: ref #278813
2018-10-26 16:38:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 16:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278813  12 58417 59919153 A  ERRORB¢ff'
2018-10-26 16:38:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 16:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 16:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-26 16:38:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:39:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:39:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 16:39:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:39:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:39:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:39:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:39:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:39:00 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-10-26 16:39:08 [DEBUG   ] Got command BAM from MCS: ref #278814
2018-10-26 16:39:08 [INFO    ] Finished processing BAM request
2018-10-26 16:39:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:39:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278814   8 58417 59948029 A  ERROR'
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:39:08 [DEBUG   ] spawn_process: at 2018-10-26 16:39:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:39:17 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-26 16:39:23 [DEBUG   ] Got command BAM from MCS: ref #278815
2018-10-26 16:39:23 [INFO    ] Finished processing BAM request
2018-10-26 16:39:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:39:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278815   8 58417 59963033 A  ERROR'
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:39:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:39:23 [DEBUG   ] spawn_process: at 2018-10-26 16:39:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:39:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 16:39:58 [DEBUG   ] Got command BAM from MCS: ref #278816
2018-10-26 16:39:58 [INFO    ] Finished processing BAM request
2018-10-26 16:39:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:39:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278816   8 58417 59998033 A  ERROR'
2018-10-26 16:39:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:39:58 [DEBUG   ] spawn_process: at 2018-10-26 16:39:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:39:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:40:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:40:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:40:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:40:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:40:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:40:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:40:00 [DEBUG   ] Finished updating board flags in 0.980 seconds
2018-10-26 16:40:12 [DEBUG   ] Got command BAM from MCS: ref #278817
2018-10-26 16:40:12 [INFO    ] Finished processing BAM request
2018-10-26 16:40:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278817   8 58417 60012033 A  ERROR'
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:40:12 [DEBUG   ] spawn_process: at 2018-10-26 16:40:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:40:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 16:40:37 [DEBUG   ] Got command RPT from MCS: ref #278818
2018-10-26 16:40:37 [DEBUG   ] summary = ERROR
2018-10-26 16:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278818  13 58417 60037453 A  ERRORERROR'
2018-10-26 16:40:37 [DEBUG   ] Got command RPT from MCS: ref #278819
2018-10-26 16:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278819  77 58417 60037454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:40:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 16:40:48 [DEBUG   ] Got command BAM from MCS: ref #278835
2018-10-26 16:40:48 [INFO    ] Finished processing BAM request
2018-10-26 16:40:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278835   8 58417 60048029 A  ERROR'
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:40:48 [DEBUG   ] spawn_process: at 2018-10-26 16:40:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:40:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 16:41:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 16:41:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:41:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:41:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:41:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:41:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:41:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:41:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:41:00 [DEBUG   ] Finished updating board flags in 1.263 seconds
2018-10-26 16:41:01 [DEBUG   ] Got command BAM from MCS: ref #278840
2018-10-26 16:41:01 [INFO    ] Finished processing BAM request
2018-10-26 16:41:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:41:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278840   8 58417 60061025 A  ERROR'
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:41:01 [DEBUG   ] spawn_process: at 2018-10-26 16:41:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:41:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 16:41:37 [DEBUG   ] Got command BAM from MCS: ref #278841
2018-10-26 16:41:37 [INFO    ] Finished processing BAM request
2018-10-26 16:41:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:41:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278841   8 58417 60097033 A  ERROR'
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:41:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:41:37 [DEBUG   ] spawn_process: at 2018-10-26 16:41:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:41:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 16:41:50 [DEBUG   ] Got command BAM from MCS: ref #278842
2018-10-26 16:41:50 [INFO    ] Finished processing BAM request
2018-10-26 16:41:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:41:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278842   8 58417 60110033 A  ERROR'
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:41:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:41:50 [DEBUG   ] spawn_process: at 2018-10-26 16:41:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:41:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 16:42:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 16:42:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 16:42:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:42:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:42:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:42:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:42:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:42:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:42:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:42:00 [DEBUG   ] Finished updating board flags in 1.201 seconds
2018-10-26 16:42:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 16:42:26 [DEBUG   ] Got command BAM from MCS: ref #278843
2018-10-26 16:42:26 [INFO    ] Finished processing BAM request
2018-10-26 16:42:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:42:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278843   8 58417 60146033 A  ERROR'
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:42:26 [DEBUG   ] spawn_process: at 2018-10-26 16:42:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:42:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 16:42:39 [DEBUG   ] Got command BAM from MCS: ref #278844
2018-10-26 16:42:39 [INFO    ] Finished processing BAM request
2018-10-26 16:42:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:42:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278844   8 58417 60159033 A  ERROR'
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:42:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:42:39 [DEBUG   ] spawn_process: at 2018-10-26 16:42:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:42:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 16:43:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 16:43:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:43:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-26 16:43:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:43:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 16:43:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:43:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:43:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:43:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:43:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:43:01 [DEBUG   ] Finished updating board flags in 1.770 seconds
2018-10-26 16:43:15 [DEBUG   ] Got command BAM from MCS: ref #278845
2018-10-26 16:43:15 [INFO    ] Finished processing BAM request
2018-10-26 16:43:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:43:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278845   8 58417 60195029 A  ERROR'
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:43:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:43:15 [DEBUG   ] spawn_process: at 2018-10-26 16:43:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:43:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 16:43:27 [DEBUG   ] Got command BAM from MCS: ref #278848
2018-10-26 16:43:27 [INFO    ] Finished processing BAM request
2018-10-26 16:43:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278848   8 58417 60207025 A  ERROR'
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:43:27 [DEBUG   ] spawn_process: at 2018-10-26 16:43:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:43:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 16:43:38 [DEBUG   ] Got command RPT from MCS: ref #278849
2018-10-26 16:43:38 [DEBUG   ] summary = ERROR
2018-10-26 16:43:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278849  13 58417 60218441 A  ERRORERROR'
2018-10-26 16:43:38 [DEBUG   ] Got command RPT from MCS: ref #278850
2018-10-26 16:43:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:43:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278850  77 58417 60218645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:43:38 [DEBUG   ] Got command RPT from MCS: ref #278851
2018-10-26 16:43:38 [DEBUG   ] summary = ERROR
2018-10-26 16:43:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278851  13 58417 60218837 A  ERRORERROR'
2018-10-26 16:43:39 [DEBUG   ] Got command RPT from MCS: ref #278853
2018-10-26 16:43:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278853  77 58417 60219041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:43:39 [DEBUG   ] Got command RPT from MCS: ref #278854
2018-10-26 16:43:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 16:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278854  12 58417 60219245 A  ERRORB¢ff'
2018-10-26 16:43:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 16:44:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 16:44:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:44:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2018-10-26 16:44:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:44:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:44:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:44:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:44:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:44:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:44:00 [DEBUG   ] Finished updating board flags in 1.030 seconds
2018-10-26 16:44:04 [DEBUG   ] Got command BAM from MCS: ref #278863
2018-10-26 16:44:04 [INFO    ] Finished processing BAM request
2018-10-26 16:44:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:44:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278863   8 58417 60244025 A  ERROR'
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:44:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:44:04 [DEBUG   ] spawn_process: at 2018-10-26 16:44:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:44:15 [DEBUG   ] Got command BAM from MCS: ref #278864
2018-10-26 16:44:15 [INFO    ] Finished processing BAM request
2018-10-26 16:44:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:44:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278864   8 58417 60255033 A  ERROR'
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:44:15 [DEBUG   ] spawn_process: at 2018-10-26 16:44:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:44:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 16:44:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 16:44:53 [DEBUG   ] Got command BAM from MCS: ref #278865
2018-10-26 16:44:53 [INFO    ] Finished processing BAM request
2018-10-26 16:44:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:44:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278865   8 58417 60293029 A  ERROR'
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:44:53 [DEBUG   ] spawn_process: at 2018-10-26 16:44:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:44:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 16:45:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-26 16:45:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:45:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 16:45:01 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:45:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:45:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:45:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:45:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:45:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:45:01 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-10-26 16:45:03 [DEBUG   ] Got command BAM from MCS: ref #278866
2018-10-26 16:45:03 [INFO    ] Finished processing BAM request
2018-10-26 16:45:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278866   8 58417 60303033 A  ERROR'
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:45:03 [DEBUG   ] spawn_process: at 2018-10-26 16:45:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:45:18 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-10-26 16:45:37 [DEBUG   ] Got command RPT from MCS: ref #278867
2018-10-26 16:45:37 [DEBUG   ] summary = ERROR
2018-10-26 16:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278867  13 58417 60337457 A  ERRORERROR'
2018-10-26 16:45:37 [DEBUG   ] Got command RPT from MCS: ref #278868
2018-10-26 16:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278868  77 58417 60337458 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:45:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 16:45:42 [DEBUG   ] Got command BAM from MCS: ref #278884
2018-10-26 16:45:42 [INFO    ] Finished processing BAM request
2018-10-26 16:45:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:45:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278884   8 58417 60342033 A  ERROR'
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:45:42 [DEBUG   ] spawn_process: at 2018-10-26 16:45:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:45:51 [DEBUG   ] Got command BAM from MCS: ref #278885
2018-10-26 16:45:51 [INFO    ] Finished processing BAM request
2018-10-26 16:45:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:45:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278885   8 58417 60351025 A  ERROR'
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:45:51 [DEBUG   ] spawn_process: at 2018-10-26 16:45:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:45:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:46:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 16:46:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 16:46:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:46:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:46:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:46:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:46:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:46:00 [WARNING ] (13, 1, 'bot')
2018-10-26 16:46:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:46:00 [DEBUG   ] Finished updating board flags in 0.972 seconds
2018-10-26 16:46:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:46:30 [DEBUG   ] Got command BAM from MCS: ref #278886
2018-10-26 16:46:30 [INFO    ] Finished processing BAM request
2018-10-26 16:46:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:46:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278886   8 58417 60390025 A  ERROR'
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:46:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:46:30 [DEBUG   ] spawn_process: at 2018-10-26 16:46:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:46:38 [DEBUG   ] Got command BAM from MCS: ref #278887
2018-10-26 16:46:38 [INFO    ] Finished processing BAM request
2018-10-26 16:46:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278887   8 58417 60398033 A  ERROR'
2018-10-26 16:46:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:46:38 [DEBUG   ] spawn_process: at 2018-10-26 16:46:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:46:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:47:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:47:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:47:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:47:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:47:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:47:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:47:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:47:01 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-10-26 16:47:18 [DEBUG   ] Got command BAM from MCS: ref #278892
2018-10-26 16:47:18 [INFO    ] Finished processing BAM request
2018-10-26 16:47:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:47:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278892   8 58417 60438025 A  ERROR'
2018-10-26 16:47:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:47:18 [DEBUG   ] spawn_process: at 2018-10-26 16:47:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:47:25 [DEBUG   ] Got command BAM from MCS: ref #278893
2018-10-26 16:47:25 [INFO    ] Finished processing BAM request
2018-10-26 16:47:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:47:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278893   8 58417 60445025 A  ERROR'
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:47:25 [DEBUG   ] spawn_process: at 2018-10-26 16:47:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:47:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:47:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:48:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 16:48:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 16:48:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:48:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 16:48:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:48:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 16:48:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:48:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:48:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:48:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:48:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:48:01 [DEBUG   ] Finished updating board flags in 1.190 seconds
2018-10-26 16:48:06 [DEBUG   ] Got command BAM from MCS: ref #278894
2018-10-26 16:48:06 [INFO    ] Finished processing BAM request
2018-10-26 16:48:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:48:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278894   8 58417 60486033 A  ERROR'
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:48:06 [DEBUG   ] spawn_process: at 2018-10-26 16:48:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:48:12 [DEBUG   ] Got command BAM from MCS: ref #278895
2018-10-26 16:48:12 [INFO    ] Finished processing BAM request
2018-10-26 16:48:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:48:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278895   8 58417 60492049 A  ERROR'
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:48:12 [DEBUG   ] spawn_process: at 2018-10-26 16:48:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:48:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 16:48:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:48:38 [DEBUG   ] Got command RPT from MCS: ref #278896
2018-10-26 16:48:38 [DEBUG   ] summary = ERROR
2018-10-26 16:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278896  13 58417 60518525 A  ERRORERROR'
2018-10-26 16:48:38 [DEBUG   ] Got command RPT from MCS: ref #278897
2018-10-26 16:48:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278897  77 58417 60518729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:48:38 [DEBUG   ] Got command RPT from MCS: ref #278898
2018-10-26 16:48:38 [DEBUG   ] summary = ERROR
2018-10-26 16:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278898  13 58417 60518921 A  ERRORERROR'
2018-10-26 16:48:39 [DEBUG   ] Got command RPT from MCS: ref #278899
2018-10-26 16:48:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278899  77 58417 60519125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:48:39 [DEBUG   ] Got command RPT from MCS: ref #278900
2018-10-26 16:48:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 16:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278900  12 58417 60519329 A  ERRORB¢ff'
2018-10-26 16:48:54 [DEBUG   ] Got command BAM from MCS: ref #278901
2018-10-26 16:48:54 [INFO    ] Finished processing BAM request
2018-10-26 16:48:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:48:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278901   8 58417 60534033 A  ERROR'
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:48:55 [DEBUG   ] spawn_process: at 2018-10-26 16:48:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:48:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:48:59 [DEBUG   ] Got command BAM from MCS: ref #278902
2018-10-26 16:48:59 [INFO    ] Finished processing BAM request
2018-10-26 16:48:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:48:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278902   8 58417 60539033 A  ERROR'
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:48:59 [DEBUG   ] spawn_process: at 2018-10-26 16:48:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:49:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 16:49:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:49:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 16:49:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:49:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:49:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:49:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:49:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:49:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:49:01 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-10-26 16:49:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 16:49:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 16:49:42 [DEBUG   ] Got command BAM from MCS: ref #278903
2018-10-26 16:49:42 [INFO    ] Finished processing BAM request
2018-10-26 16:49:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:49:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278903   8 58417 60582033 A  ERROR'
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:49:42 [DEBUG   ] spawn_process: at 2018-10-26 16:49:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:49:46 [DEBUG   ] Got command BAM from MCS: ref #278904
2018-10-26 16:49:46 [INFO    ] Finished processing BAM request
2018-10-26 16:49:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:49:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278904   8 58417 60586033 A  ERROR'
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:49:46 [DEBUG   ] spawn_process: at 2018-10-26 16:49:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:49:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 16:50:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 16:50:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:50:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:50:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 16:50:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:50:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:50:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:50:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:50:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:50:01 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-10-26 16:50:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 16:50:30 [DEBUG   ] Got command BAM from MCS: ref #278909
2018-10-26 16:50:30 [INFO    ] Finished processing BAM request
2018-10-26 16:50:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:50:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278909   8 58417 60630029 A  ERROR'
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:50:30 [DEBUG   ] spawn_process: at 2018-10-26 16:50:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:50:32 [DEBUG   ] Got command BAM from MCS: ref #278910
2018-10-26 16:50:32 [INFO    ] Finished processing BAM request
2018-10-26 16:50:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:50:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278910   8 58417 60632033 A  ERROR'
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:50:32 [DEBUG   ] spawn_process: at 2018-10-26 16:50:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:50:37 [DEBUG   ] Got command RPT from MCS: ref #278911
2018-10-26 16:50:37 [DEBUG   ] summary = ERROR
2018-10-26 16:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278911  13 58417 60637457 A  ERRORERROR'
2018-10-26 16:50:37 [DEBUG   ] Got command RPT from MCS: ref #278912
2018-10-26 16:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278912  77 58417 60637458 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:50:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 16:50:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 16:51:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:51:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 16:51:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:51:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:51:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:51:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:51:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:51:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:51:01 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-10-26 16:51:18 [DEBUG   ] Got command BAM from MCS: ref #278929
2018-10-26 16:51:18 [INFO    ] Finished processing BAM request
2018-10-26 16:51:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278929   8 58417 60678033 A  ERROR'
2018-10-26 16:51:18 [DEBUG   ] Got command BAM from MCS: ref #278928
2018-10-26 16:51:18 [INFO    ] Finished processing BAM request
2018-10-26 16:51:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278928   8 58417 60678037 A  ERROR'
2018-10-26 16:51:18 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:51:18 [DEBUG   ] spawn_process: at 2018-10-26 16:51:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:51:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 16:51:59 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 16:52:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 16:52:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:52:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:52:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:52:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:52:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:52:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:52:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:52:01 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-26 16:52:04 [DEBUG   ] Got command BAM from MCS: ref #278930
2018-10-26 16:52:04 [INFO    ] Finished processing BAM request
2018-10-26 16:52:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:52:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278930   8 58417 60724033 A  ERROR'
2018-10-26 16:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:52:04 [DEBUG   ] spawn_process: at 2018-10-26 16:52:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:52:05 [DEBUG   ] spawn_process: at 2018-10-26 16:52:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:52:06 [DEBUG   ] Got command BAM from MCS: ref #278931
2018-10-26 16:52:06 [INFO    ] Finished processing BAM request
2018-10-26 16:52:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:52:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278931   8 58417 60726029 A  ERROR'
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:52:06 [DEBUG   ] spawn_process: at 2018-10-26 16:52:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:52:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 16:52:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 16:52:50 [DEBUG   ] Got command BAM from MCS: ref #278932
2018-10-26 16:52:50 [INFO    ] Finished processing BAM request
2018-10-26 16:52:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:52:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278932   8 58417 60770029 A  ERROR'
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:52:50 [DEBUG   ] spawn_process: at 2018-10-26 16:52:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:52:53 [DEBUG   ] Got command BAM from MCS: ref #278933
2018-10-26 16:52:53 [INFO    ] Finished processing BAM request
2018-10-26 16:52:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:52:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278933   8 58417 60773025 A  ERROR'
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:52:53 [DEBUG   ] spawn_process: at 2018-10-26 16:52:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:52:59 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 16:53:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:53:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:53:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:53:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:53:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:53:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:53:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:53:01 [DEBUG   ] Finished updating board flags in 1.372 seconds
2018-10-26 16:53:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:53:36 [DEBUG   ] Got command BAM from MCS: ref #278940
2018-10-26 16:53:36 [INFO    ] Finished processing BAM request
2018-10-26 16:53:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278940   8 58417 60816025 A  ERROR'
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:53:36 [DEBUG   ] spawn_process: at 2018-10-26 16:53:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:53:38 [DEBUG   ] Got command RPT from MCS: ref #278941
2018-10-26 16:53:38 [DEBUG   ] summary = ERROR
2018-10-26 16:53:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278941  13 58417 60818617 A  ERRORERROR'
2018-10-26 16:53:38 [DEBUG   ] Got command RPT from MCS: ref #278942
2018-10-26 16:53:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:53:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278942  77 58417 60818813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:53:39 [DEBUG   ] Got command RPT from MCS: ref #278943
2018-10-26 16:53:39 [DEBUG   ] summary = ERROR
2018-10-26 16:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278943  13 58417 60819017 A  ERRORERROR'
2018-10-26 16:53:39 [DEBUG   ] Got command RPT from MCS: ref #278946
2018-10-26 16:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278946  77 58417 60819209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:53:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:53:39 [DEBUG   ] Got command RPT from MCS: ref #278947
2018-10-26 16:53:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 16:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278947  12 58417 60819413 A  ERRORB¢ff'
2018-10-26 16:53:40 [DEBUG   ] Got command BAM from MCS: ref #278944
2018-10-26 16:53:40 [INFO    ] Finished processing BAM request
2018-10-26 16:53:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278944   8 58417 60820029 A  ERROR'
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 16:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 16:53:40 [DEBUG   ] spawn_process: at 2018-10-26 16:53:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 16:53:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:54:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:54:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:54:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 16:54:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:54:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:54:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:54:01 [WARNING ] (13, 1, 'bot')
2018-10-26 16:54:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:54:01 [DEBUG   ] Finished updating board flags in 1.203 seconds
2018-10-26 16:54:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:54:21 [DEBUG   ] Got command BAM from MCS: ref #278952
2018-10-26 16:54:21 [INFO    ] Finished processing BAM request
2018-10-26 16:54:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:54:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278952   8 58417 60861029 A  ERROR'
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:54:21 [DEBUG   ] spawn_process: at 2018-10-26 16:54:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:54:27 [DEBUG   ] Got command BAM from MCS: ref #278953
2018-10-26 16:54:27 [INFO    ] Finished processing BAM request
2018-10-26 16:54:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:54:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278953   8 58417 60867033 A  ERROR'
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:54:27 [DEBUG   ] spawn_process: at 2018-10-26 16:54:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:54:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:54:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:55:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:55:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:55:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:55:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:55:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:55:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:55:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:55:02 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-10-26 16:55:06 [DEBUG   ] Got command BAM from MCS: ref #278954
2018-10-26 16:55:06 [INFO    ] Finished processing BAM request
2018-10-26 16:55:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:55:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278954   8 58417 60906025 A  ERROR'
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:55:06 [DEBUG   ] spawn_process: at 2018-10-26 16:55:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:55:14 [DEBUG   ] Got command BAM from MCS: ref #278955
2018-10-26 16:55:14 [INFO    ] Finished processing BAM request
2018-10-26 16:55:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:55:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278955   8 58417 60914029 A  ERROR'
2018-10-26 16:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:55:14 [DEBUG   ] spawn_process: at 2018-10-26 16:55:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:55:15 [DEBUG   ] spawn_process: at 2018-10-26 16:55:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:55:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 16:55:37 [DEBUG   ] Got command RPT from MCS: ref #278956
2018-10-26 16:55:37 [DEBUG   ] summary = ERROR
2018-10-26 16:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278956  13 58417 60937453 A  ERRORERROR'
2018-10-26 16:55:37 [DEBUG   ] Got command RPT from MCS: ref #278957
2018-10-26 16:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278957  77 58417 60937454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:55:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:55:51 [DEBUG   ] Got command BAM from MCS: ref #278973
2018-10-26 16:55:51 [INFO    ] Finished processing BAM request
2018-10-26 16:55:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:55:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278973   8 58417 60951033 A  ERROR'
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:55:51 [DEBUG   ] spawn_process: at 2018-10-26 16:55:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:55:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 16:56:01 [DEBUG   ] Got command BAM from MCS: ref #278978
2018-10-26 16:56:01 [INFO    ] Finished processing BAM request
2018-10-26 16:56:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:56:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278978   8 58417 60961025 A  ERROR'
2018-10-26 16:56:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:56:01 [DEBUG   ] spawn_process: at 2018-10-26 16:56:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:56:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:56:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 16:56:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 16:56:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:56:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:56:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:56:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:56:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:56:02 [DEBUG   ] Finished updating board flags in 1.560 seconds
2018-10-26 16:56:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:56:36 [DEBUG   ] Got command BAM from MCS: ref #278979
2018-10-26 16:56:36 [INFO    ] Finished processing BAM request
2018-10-26 16:56:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:56:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278979   8 58417 60996030 A  ERROR'
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:56:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:56:36 [DEBUG   ] spawn_process: at 2018-10-26 16:56:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:56:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:56:48 [DEBUG   ] Got command BAM from MCS: ref #278980
2018-10-26 16:56:48 [INFO    ] Finished processing BAM request
2018-10-26 16:56:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:56:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278980   8 58417 61008034 A  ERROR'
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:56:48 [DEBUG   ] spawn_process: at 2018-10-26 16:56:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:56:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:57:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:57:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 16:57:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:57:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:57:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:57:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:57:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:57:02 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-10-26 16:57:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 16:57:20 [DEBUG   ] Got command BAM from MCS: ref #278981
2018-10-26 16:57:20 [INFO    ] Finished processing BAM request
2018-10-26 16:57:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:57:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278981   8 58417 61040030 A  ERROR'
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 16:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 16:57:20 [DEBUG   ] spawn_process: at 2018-10-26 16:57:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 16:57:35 [DEBUG   ] Got command BAM from MCS: ref #278982
2018-10-26 16:57:35 [INFO    ] Finished processing BAM request
2018-10-26 16:57:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278982   8 58417 61055025 A  ERROR'
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 16:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 16:57:35 [DEBUG   ] spawn_process: at 2018-10-26 16:57:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 16:57:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:57:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:58:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:58:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:58:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 16:58:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:58:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:58:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:58:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:58:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:58:02 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-10-26 16:58:04 [DEBUG   ] Got command BAM from MCS: ref #278983
2018-10-26 16:58:04 [INFO    ] Finished processing BAM request
2018-10-26 16:58:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:58:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278983   8 58417 61084025 A  ERROR'
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:58:04 [DEBUG   ] spawn_process: at 2018-10-26 16:58:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:58:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:58:21 [DEBUG   ] Got command BAM from MCS: ref #278984
2018-10-26 16:58:21 [INFO    ] Finished processing BAM request
2018-10-26 16:58:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278984   8 58417 61101029 A  ERROR'
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:58:21 [DEBUG   ] spawn_process: at 2018-10-26 16:58:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:58:38 [DEBUG   ] Got command RPT from MCS: ref #278985
2018-10-26 16:58:38 [DEBUG   ] summary = ERROR
2018-10-26 16:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278985  13 58417 61118698 A  ERRORERROR'
2018-10-26 16:58:38 [DEBUG   ] Got command RPT from MCS: ref #278986
2018-10-26 16:58:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278986  77 58417 61118894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:58:39 [DEBUG   ] Got command RPT from MCS: ref #278987
2018-10-26 16:58:39 [DEBUG   ] summary = ERROR
2018-10-26 16:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278987  13 58417 61119097 A  ERRORERROR'
2018-10-26 16:58:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:58:39 [DEBUG   ] Got command RPT from MCS: ref #278988
2018-10-26 16:58:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 16:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278988  77 58417 61119301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 16:58:39 [DEBUG   ] Got command RPT from MCS: ref #278989
2018-10-26 16:58:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 16:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278989  12 58417 61119506 A  ERRORB¡ff'
2018-10-26 16:58:48 [DEBUG   ] Got command BAM from MCS: ref #278990
2018-10-26 16:58:48 [INFO    ] Finished processing BAM request
2018-10-26 16:58:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:58:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278990   8 58417 61128029 A  ERROR'
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:58:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:58:48 [DEBUG   ] spawn_process: at 2018-10-26 16:58:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:58:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:59:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 16:59:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 16:59:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 16:59:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 16:59:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-26 16:59:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 16:59:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:59:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:59:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:59:02 [WARNING ] (13, 1, 'bot')
2018-10-26 16:59:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 16:59:02 [DEBUG   ] Finished updating board flags in 1.212 seconds
2018-10-26 16:59:07 [DEBUG   ] Got command BAM from MCS: ref #278995
2018-10-26 16:59:07 [INFO    ] Finished processing BAM request
2018-10-26 16:59:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:59:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278995   8 58417 61147029 A  ERROR'
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:59:07 [DEBUG   ] spawn_process: at 2018-10-26 16:59:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:59:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 16:59:32 [DEBUG   ] Got command BAM from MCS: ref #278996
2018-10-26 16:59:32 [INFO    ] Finished processing BAM request
2018-10-26 16:59:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:59:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278996   8 58417 61172025 A  ERROR'
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 16:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 16:59:32 [DEBUG   ] spawn_process: at 2018-10-26 16:59:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 16:59:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 16:59:53 [DEBUG   ] Got command BAM from MCS: ref #278997
2018-10-26 16:59:53 [INFO    ] Finished processing BAM request
2018-10-26 16:59:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 16:59:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278997   8 58417 61193033 A  ERROR'
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 16:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 16:59:53 [DEBUG   ] spawn_process: at 2018-10-26 16:59:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 16:59:59 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 17:00:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 17:00:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-26 17:00:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-26 17:00:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:00:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:00:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 17:00:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:00:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:00:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:00:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:00:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:00:02 [DEBUG   ] Finished updating board flags in 1.194 seconds
2018-10-26 17:00:16 [DEBUG   ] Got command BAM from MCS: ref #278998
2018-10-26 17:00:16 [INFO    ] Finished processing BAM request
2018-10-26 17:00:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:00:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   278998   8 58417 61216025 A  ERROR'
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:00:16 [DEBUG   ] spawn_process: at 2018-10-26 17:00:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:00:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:00:37 [DEBUG   ] Got command RPT from MCS: ref #278999
2018-10-26 17:00:37 [DEBUG   ] summary = ERROR
2018-10-26 17:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   278999  13 58417 61237453 A  ERRORERROR'
2018-10-26 17:00:37 [DEBUG   ] Got command RPT from MCS: ref #279000
2018-10-26 17:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279000  77 58417 61237454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:00:39 [DEBUG   ] Got command BAM from MCS: ref #279016
2018-10-26 17:00:39 [INFO    ] Finished processing BAM request
2018-10-26 17:00:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279016   8 58417 61239033 A  ERROR'
2018-10-26 17:00:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:00:39 [DEBUG   ] spawn_process: at 2018-10-26 17:00:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:00:59 [DEBUG   ] Got command BAM from MCS: ref #279017
2018-10-26 17:00:59 [INFO    ] Finished processing BAM request
2018-10-26 17:00:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:00:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279017   8 58417 61259029 A  ERROR'
2018-10-26 17:00:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:00:59 [DEBUG   ] spawn_process: at 2018-10-26 17:00:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:01:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:01:00 [DEBUG   ] spawn_process: at 2018-10-26 17:01:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:01:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:01:00 [DEBUG   ] spawn_process: at 2018-10-26 17:01:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:01:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:01:00 [DEBUG   ] spawn_process: at 2018-10-26 17:01:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:01:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:01:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:01:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:01:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:01:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:01:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:01:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:01:02 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-10-26 17:01:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:01:25 [DEBUG   ] Got command BAM from MCS: ref #279018
2018-10-26 17:01:25 [INFO    ] Finished processing BAM request
2018-10-26 17:01:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:01:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279018   8 58417 61285029 A  ERROR'
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:01:25 [DEBUG   ] spawn_process: at 2018-10-26 17:01:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:01:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:01:42 [DEBUG   ] Got command BAM from MCS: ref #279019
2018-10-26 17:01:42 [INFO    ] Finished processing BAM request
2018-10-26 17:01:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279019   8 58417 61302025 A  ERROR'
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:01:42 [DEBUG   ] spawn_process: at 2018-10-26 17:01:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:01:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:02:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 17:02:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 17:02:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:02:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:02:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 17:02:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:02:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:02:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:02:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:02:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:02:02 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-10-26 17:02:11 [DEBUG   ] Got command BAM from MCS: ref #279024
2018-10-26 17:02:11 [INFO    ] Finished processing BAM request
2018-10-26 17:02:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:02:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279024   8 58417 61331029 A  ERROR'
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:02:11 [DEBUG   ] spawn_process: at 2018-10-26 17:02:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:02:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 17:02:25 [DEBUG   ] Got command BAM from MCS: ref #279025
2018-10-26 17:02:25 [INFO    ] Finished processing BAM request
2018-10-26 17:02:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:02:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279025   8 58417 61345025 A  ERROR'
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:02:25 [DEBUG   ] spawn_process: at 2018-10-26 17:02:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:02:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:02:57 [DEBUG   ] Got command BAM from MCS: ref #279026
2018-10-26 17:02:57 [INFO    ] Finished processing BAM request
2018-10-26 17:02:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:02:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279026   8 58417 61377029 A  ERROR'
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:02:57 [DEBUG   ] spawn_process: at 2018-10-26 17:02:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:02:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:03:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 17:03:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 17:03:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:03:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 17:03:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:03:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:03:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:03:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:03:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:03:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:03:02 [DEBUG   ] Finished updating board flags in 0.975 seconds
2018-10-26 17:03:08 [DEBUG   ] Got command BAM from MCS: ref #279027
2018-10-26 17:03:08 [INFO    ] Finished processing BAM request
2018-10-26 17:03:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:03:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279027   8 58417 61388033 A  ERROR'
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:03:08 [DEBUG   ] spawn_process: at 2018-10-26 17:03:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:03:19 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-26 17:03:38 [DEBUG   ] Got command RPT from MCS: ref #279030
2018-10-26 17:03:38 [DEBUG   ] summary = ERROR
2018-10-26 17:03:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279030  13 58417 61418777 A  ERRORERROR'
2018-10-26 17:03:38 [DEBUG   ] Got command RPT from MCS: ref #279031
2018-10-26 17:03:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:03:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279031  77 58417 61418981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:03:39 [DEBUG   ] Got command RPT from MCS: ref #279032
2018-10-26 17:03:39 [DEBUG   ] summary = ERROR
2018-10-26 17:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279032  13 58417 61419185 A  ERRORERROR'
2018-10-26 17:03:39 [DEBUG   ] Got command RPT from MCS: ref #279034
2018-10-26 17:03:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279034  77 58417 61419377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:03:39 [DEBUG   ] Got command RPT from MCS: ref #279036
2018-10-26 17:03:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 17:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279036  12 58417 61419581 A  ERRORB¢ff'
2018-10-26 17:03:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 17:03:43 [DEBUG   ] Got command BAM from MCS: ref #279040
2018-10-26 17:03:43 [INFO    ] Finished processing BAM request
2018-10-26 17:03:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:03:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279040   8 58417 61423029 A  ERROR'
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:03:43 [DEBUG   ] spawn_process: at 2018-10-26 17:03:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:03:51 [DEBUG   ] Got command BAM from MCS: ref #279041
2018-10-26 17:03:51 [INFO    ] Finished processing BAM request
2018-10-26 17:03:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:03:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279041   8 58417 61431025 A  ERROR'
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:03:51 [DEBUG   ] spawn_process: at 2018-10-26 17:03:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:04:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 17:04:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 17:04:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:04:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 17:04:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:04:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:04:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:04:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:04:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:04:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:04:02 [DEBUG   ] Finished updating board flags in 1.279 seconds
2018-10-26 17:04:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 17:04:28 [DEBUG   ] Got command BAM from MCS: ref #279042
2018-10-26 17:04:28 [INFO    ] Finished processing BAM request
2018-10-26 17:04:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:04:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279042   8 58417 61468025 A  ERROR'
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:04:28 [DEBUG   ] spawn_process: at 2018-10-26 17:04:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:04:33 [DEBUG   ] Got command BAM from MCS: ref #279043
2018-10-26 17:04:33 [INFO    ] Finished processing BAM request
2018-10-26 17:04:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:04:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279043   8 58417 61473025 A  ERROR'
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:04:33 [DEBUG   ] spawn_process: at 2018-10-26 17:04:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:04:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 17:05:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 17:05:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:05:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:05:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:05:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:05:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:05:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:05:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:05:02 [DEBUG   ] Finished updating board flags in 1.241 seconds
2018-10-26 17:05:13 [DEBUG   ] Got command BAM from MCS: ref #279048
2018-10-26 17:05:13 [INFO    ] Finished processing BAM request
2018-10-26 17:05:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:05:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279048   8 58417 61513029 A  ERROR'
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:05:13 [DEBUG   ] spawn_process: at 2018-10-26 17:05:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:05:15 [DEBUG   ] Got command BAM from MCS: ref #279049
2018-10-26 17:05:15 [INFO    ] Finished processing BAM request
2018-10-26 17:05:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279049   8 58417 61515025 A  ERROR'
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:05:15 [DEBUG   ] spawn_process: at 2018-10-26 17:05:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:05:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 17:05:37 [DEBUG   ] Got command RPT from MCS: ref #279050
2018-10-26 17:05:37 [DEBUG   ] summary = ERROR
2018-10-26 17:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279050  13 58417 61537457 A  ERRORERROR'
2018-10-26 17:05:37 [DEBUG   ] Got command RPT from MCS: ref #279051
2018-10-26 17:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279051  77 58417 61537458 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:05:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 17:05:57 [DEBUG   ] Got command BAM from MCS: ref #279067
2018-10-26 17:05:57 [INFO    ] Finished processing BAM request
2018-10-26 17:05:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:05:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279067   8 58417 61557033 A  ERROR'
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:05:57 [DEBUG   ] spawn_process: at 2018-10-26 17:05:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:05:58 [DEBUG   ] Got command BAM from MCS: ref #279068
2018-10-26 17:05:58 [INFO    ] Finished processing BAM request
2018-10-26 17:05:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279068   8 58417 61558033 A  ERROR'
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:05:58 [DEBUG   ] spawn_process: at 2018-10-26 17:05:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:06:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 17:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-26 17:06:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:06:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:06:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:06:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:06:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:06:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:06:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:06:02 [DEBUG   ] Finished updating board flags in 1.160 seconds
2018-10-26 17:06:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:06:39 [DEBUG   ] Got command BAM from MCS: ref #279069
2018-10-26 17:06:39 [INFO    ] Finished processing BAM request
2018-10-26 17:06:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279069   8 58417 61599029 A  ERROR'
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:06:39 [DEBUG   ] spawn_process: at 2018-10-26 17:06:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:06:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:06:43 [DEBUG   ] Got command BAM from MCS: ref #279070
2018-10-26 17:06:43 [INFO    ] Finished processing BAM request
2018-10-26 17:06:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279070   8 58417 61603029 A  ERROR'
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:06:43 [DEBUG   ] spawn_process: at 2018-10-26 17:06:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:07:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:07:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:07:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 17:07:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:07:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:07:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:07:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:07:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:07:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:07:02 [DEBUG   ] Finished updating board flags in 1.025 seconds
2018-10-26 17:07:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:07:21 [DEBUG   ] Got command BAM from MCS: ref #279071
2018-10-26 17:07:21 [INFO    ] Finished processing BAM request
2018-10-26 17:07:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:07:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279071   8 58417 61641029 A  ERROR'
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:07:21 [DEBUG   ] spawn_process: at 2018-10-26 17:07:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:07:28 [DEBUG   ] Got command BAM from MCS: ref #279072
2018-10-26 17:07:28 [INFO    ] Finished processing BAM request
2018-10-26 17:07:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279072   8 58417 61648029 A  ERROR'
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:07:28 [DEBUG   ] spawn_process: at 2018-10-26 17:07:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:07:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:08:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:08:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 17:08:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 17:08:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:08:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 17:08:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:08:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:08:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:08:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:08:02 [WARNING ] (13, 1, 'bot')
2018-10-26 17:08:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:08:02 [DEBUG   ] Finished updating board flags in 0.968 seconds
2018-10-26 17:08:03 [DEBUG   ] Got command BAM from MCS: ref #279077
2018-10-26 17:08:03 [INFO    ] Finished processing BAM request
2018-10-26 17:08:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:08:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279077   8 58417 61683029 A  ERROR'
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:08:03 [DEBUG   ] spawn_process: at 2018-10-26 17:08:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:08:13 [DEBUG   ] Got command BAM from MCS: ref #279078
2018-10-26 17:08:13 [INFO    ] Finished processing BAM request
2018-10-26 17:08:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:08:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279078   8 58417 61693029 A  ERROR'
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:08:13 [DEBUG   ] spawn_process: at 2018-10-26 17:08:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:08:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:08:38 [DEBUG   ] Got command RPT from MCS: ref #279079
2018-10-26 17:08:38 [DEBUG   ] summary = ERROR
2018-10-26 17:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279079  13 58417 61718869 A  ERRORERROR'
2018-10-26 17:08:39 [DEBUG   ] Got command RPT from MCS: ref #279080
2018-10-26 17:08:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279080  77 58417 61719073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:08:39 [DEBUG   ] Got command RPT from MCS: ref #279081
2018-10-26 17:08:39 [DEBUG   ] summary = ERROR
2018-10-26 17:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279081  13 58417 61719266 A  ERRORERROR'
2018-10-26 17:08:39 [DEBUG   ] Got command RPT from MCS: ref #279082
2018-10-26 17:08:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279082  77 58417 61719469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:08:39 [DEBUG   ] Got command RPT from MCS: ref #279083
2018-10-26 17:08:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 17:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279083  12 58417 61719665 A  ERRORB¢ff'
2018-10-26 17:08:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:08:44 [DEBUG   ] Got command BAM from MCS: ref #279084
2018-10-26 17:08:44 [INFO    ] Finished processing BAM request
2018-10-26 17:08:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:08:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279084   8 58417 61724025 A  ERROR'
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:08:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:08:44 [DEBUG   ] spawn_process: at 2018-10-26 17:08:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:08:58 [DEBUG   ] Got command BAM from MCS: ref #279085
2018-10-26 17:08:58 [INFO    ] Finished processing BAM request
2018-10-26 17:08:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:08:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279085   8 58417 61738033 A  ERROR'
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:08:58 [DEBUG   ] spawn_process: at 2018-10-26 17:08:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:09:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:09:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:09:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 17:09:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:09:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:09:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:09:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:09:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:09:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:09:03 [DEBUG   ] Finished updating board flags in 1.369 seconds
2018-10-26 17:09:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:09:25 [DEBUG   ] Got command BAM from MCS: ref #279086
2018-10-26 17:09:25 [INFO    ] Finished processing BAM request
2018-10-26 17:09:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:09:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279086   8 58417 61765025 A  ERROR'
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:09:25 [DEBUG   ] spawn_process: at 2018-10-26 17:09:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:09:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:09:43 [DEBUG   ] Got command BAM from MCS: ref #279087
2018-10-26 17:09:43 [INFO    ] Finished processing BAM request
2018-10-26 17:09:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:09:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279087   8 58417 61783030 A  ERROR'
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:09:43 [DEBUG   ] spawn_process: at 2018-10-26 17:09:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:10:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:10:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 17:10:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:10:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 17:10:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-26 17:10:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:10:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:10:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:10:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:10:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:10:03 [DEBUG   ] Finished updating board flags in 1.181 seconds
2018-10-26 17:10:06 [DEBUG   ] Got command BAM from MCS: ref #279088
2018-10-26 17:10:06 [INFO    ] Finished processing BAM request
2018-10-26 17:10:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:10:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279088   8 58417 61806026 A  ERROR'
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:10:06 [DEBUG   ] spawn_process: at 2018-10-26 17:10:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:10:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:10:28 [DEBUG   ] Got command BAM from MCS: ref #279089
2018-10-26 17:10:28 [INFO    ] Finished processing BAM request
2018-10-26 17:10:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:10:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279089   8 58417 61828033 A  ERROR'
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:10:28 [DEBUG   ] spawn_process: at 2018-10-26 17:10:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:10:37 [DEBUG   ] Got command RPT from MCS: ref #279090
2018-10-26 17:10:37 [DEBUG   ] summary = ERROR
2018-10-26 17:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279090  13 58417 61837453 A  ERRORERROR'
2018-10-26 17:10:37 [DEBUG   ] Got command RPT from MCS: ref #279091
2018-10-26 17:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279091  77 58417 61837454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:10:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 17:10:47 [DEBUG   ] Got command BAM from MCS: ref #279107
2018-10-26 17:10:47 [INFO    ] Finished processing BAM request
2018-10-26 17:10:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:10:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279107   8 58417 61847029 A  ERROR'
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:10:47 [DEBUG   ] spawn_process: at 2018-10-26 17:10:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:11:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:11:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 17:11:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:11:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 17:11:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:11:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:11:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:11:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:11:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:11:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:11:03 [DEBUG   ] Finished updating board flags in 1.005 seconds
2018-10-26 17:11:12 [DEBUG   ] Got command BAM from MCS: ref #279112
2018-10-26 17:11:12 [INFO    ] Finished processing BAM request
2018-10-26 17:11:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279112   8 58417 61872109 A  ERROR'
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:11:12 [DEBUG   ] spawn_process: at 2018-10-26 17:11:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:11:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:11:28 [DEBUG   ] Got command BAM from MCS: ref #279113
2018-10-26 17:11:28 [INFO    ] Finished processing BAM request
2018-10-26 17:11:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:11:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279113   8 58417 61888025 A  ERROR'
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:11:28 [DEBUG   ] spawn_process: at 2018-10-26 17:11:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:11:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:11:56 [DEBUG   ] Got command BAM from MCS: ref #279114
2018-10-26 17:11:56 [INFO    ] Finished processing BAM request
2018-10-26 17:11:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:11:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279114   8 58417 61916033 A  ERROR'
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:11:56 [DEBUG   ] spawn_process: at 2018-10-26 17:11:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:12:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:12:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:12:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 17:12:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 17:12:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-26 17:12:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:12:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:12:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:12:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:12:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:12:03 [DEBUG   ] Finished updating board flags in 0.988 seconds
2018-10-26 17:12:08 [DEBUG   ] Got command BAM from MCS: ref #279115
2018-10-26 17:12:08 [INFO    ] Finished processing BAM request
2018-10-26 17:12:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:12:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279115   8 58417 61928033 A  ERROR'
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:12:08 [DEBUG   ] spawn_process: at 2018-10-26 17:12:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:12:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 17:12:40 [DEBUG   ] Got command BAM from MCS: ref #279116
2018-10-26 17:12:40 [INFO    ] Finished processing BAM request
2018-10-26 17:12:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279116   8 58417 61960033 A  ERROR'
2018-10-26 17:12:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:12:40 [DEBUG   ] spawn_process: at 2018-10-26 17:12:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:12:48 [DEBUG   ] Got command BAM from MCS: ref #279117
2018-10-26 17:12:48 [INFO    ] Finished processing BAM request
2018-10-26 17:12:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:12:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279117   8 58417 61968033 A  ERROR'
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:12:48 [DEBUG   ] spawn_process: at 2018-10-26 17:12:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:13:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:13:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 17:13:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:13:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:13:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:13:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:13:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:13:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:13:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:13:04 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-10-26 17:13:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 17:13:24 [DEBUG   ] Got command BAM from MCS: ref #279120
2018-10-26 17:13:24 [INFO    ] Finished processing BAM request
2018-10-26 17:13:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279120   8 58417 62004025 A  ERROR'
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:13:24 [DEBUG   ] spawn_process: at 2018-10-26 17:13:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:13:28 [DEBUG   ] Got command BAM from MCS: ref #279121
2018-10-26 17:13:28 [INFO    ] Finished processing BAM request
2018-10-26 17:13:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279121   8 58417 62008025 A  ERROR'
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:13:28 [DEBUG   ] spawn_process: at 2018-10-26 17:13:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:13:38 [DEBUG   ] Got command RPT from MCS: ref #279122
2018-10-26 17:13:38 [DEBUG   ] summary = ERROR
2018-10-26 17:13:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279122  13 58417 62018957 A  ERRORERROR'
2018-10-26 17:13:39 [DEBUG   ] Got command RPT from MCS: ref #279123
2018-10-26 17:13:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279123  77 58417 62019149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:13:39 [DEBUG   ] Got command RPT from MCS: ref #279124
2018-10-26 17:13:39 [DEBUG   ] summary = ERROR
2018-10-26 17:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279124  13 58417 62019353 A  ERRORERROR'
2018-10-26 17:13:39 [DEBUG   ] Got command RPT from MCS: ref #279126
2018-10-26 17:13:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279126  77 58417 62019557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:13:39 [DEBUG   ] Got command RPT from MCS: ref #279128
2018-10-26 17:13:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 17:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279128  12 58417 62019750 A  ERRORB¢ff'
2018-10-26 17:13:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:14:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:14:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 17:14:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:14:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 17:14:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-26 17:14:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:14:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:14:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:14:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:14:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:14:03 [DEBUG   ] Finished updating board flags in 1.240 seconds
2018-10-26 17:14:08 [DEBUG   ] Got command BAM from MCS: ref #279137
2018-10-26 17:14:08 [INFO    ] Finished processing BAM request
2018-10-26 17:14:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:14:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279137   8 58417 62048033 A  ERROR'
2018-10-26 17:14:08 [DEBUG   ] Got command BAM from MCS: ref #279136
2018-10-26 17:14:08 [INFO    ] Finished processing BAM request
2018-10-26 17:14:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:14:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279136   8 58417 62048037 A  ERROR'
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:14:08 [DEBUG   ] spawn_process: at 2018-10-26 17:14:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:14:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:14:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:14:48 [DEBUG   ] Got command BAM from MCS: ref #279138
2018-10-26 17:14:48 [INFO    ] Finished processing BAM request
2018-10-26 17:14:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:14:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279138   8 58417 62088025 A  ERROR'
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:14:48 [DEBUG   ] spawn_process: at 2018-10-26 17:14:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:14:52 [DEBUG   ] Got command BAM from MCS: ref #279139
2018-10-26 17:14:52 [INFO    ] Finished processing BAM request
2018-10-26 17:14:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279139   8 58417 62092025 A  ERROR'
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:14:52 [DEBUG   ] spawn_process: at 2018-10-26 17:14:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:15:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:15:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:15:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 17:15:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:15:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:15:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:15:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:15:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:15:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:15:03 [DEBUG   ] Finished updating board flags in 1.261 seconds
2018-10-26 17:15:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:15:28 [DEBUG   ] Got command BAM from MCS: ref #279140
2018-10-26 17:15:28 [INFO    ] Finished processing BAM request
2018-10-26 17:15:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:15:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279140   8 58417 62128033 A  ERROR'
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:15:28 [DEBUG   ] spawn_process: at 2018-10-26 17:15:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:15:36 [DEBUG   ] Got command BAM from MCS: ref #279141
2018-10-26 17:15:36 [INFO    ] Finished processing BAM request
2018-10-26 17:15:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:15:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279141   8 58417 62136029 A  ERROR'
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:15:36 [DEBUG   ] spawn_process: at 2018-10-26 17:15:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:15:37 [DEBUG   ] Got command RPT from MCS: ref #279142
2018-10-26 17:15:37 [DEBUG   ] summary = ERROR
2018-10-26 17:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279142  13 58417 62137457 A  ERRORERROR'
2018-10-26 17:15:37 [DEBUG   ] Got command RPT from MCS: ref #279143
2018-10-26 17:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279143  77 58417 62137458 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:15:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:16:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:16:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:16:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:16:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:16:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:16:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:16:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:16:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:16:03 [DEBUG   ] Finished updating board flags in 1.150 seconds
2018-10-26 17:16:07 [DEBUG   ] Got command BAM from MCS: ref #279159
2018-10-26 17:16:07 [INFO    ] Finished processing BAM request
2018-10-26 17:16:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:16:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279159   8 58417 62167025 A  ERROR'
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:16:07 [DEBUG   ] spawn_process: at 2018-10-26 17:16:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:16:20 [DEBUG   ] Got command BAM from MCS: ref #279160
2018-10-26 17:16:20 [INFO    ] Finished processing BAM request
2018-10-26 17:16:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:16:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279160   8 58417 62180025 A  ERROR'
2018-10-26 17:16:20 [DEBUG   ] Finished updating ant stats in 0.582 seconds
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:16:20 [DEBUG   ] spawn_process: at 2018-10-26 17:16:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:16:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:16:46 [DEBUG   ] Got command BAM from MCS: ref #279161
2018-10-26 17:16:46 [INFO    ] Finished processing BAM request
2018-10-26 17:16:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:16:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279161   8 58417 62206029 A  ERROR'
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:16:46 [DEBUG   ] spawn_process: at 2018-10-26 17:16:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:17:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:17:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:17:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 17:17:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:17:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:17:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:17:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:17:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:17:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:17:03 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-10-26 17:17:04 [DEBUG   ] Got command BAM from MCS: ref #279166
2018-10-26 17:17:04 [INFO    ] Finished processing BAM request
2018-10-26 17:17:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:17:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279166   8 58417 62224029 A  ERROR'
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:17:04 [DEBUG   ] spawn_process: at 2018-10-26 17:17:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:17:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:17:25 [DEBUG   ] Got command BAM from MCS: ref #279167
2018-10-26 17:17:25 [INFO    ] Finished processing BAM request
2018-10-26 17:17:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:17:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279167   8 58417 62245029 A  ERROR'
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:17:25 [DEBUG   ] spawn_process: at 2018-10-26 17:17:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:17:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:17:47 [DEBUG   ] Got command BAM from MCS: ref #279168
2018-10-26 17:17:47 [INFO    ] Finished processing BAM request
2018-10-26 17:17:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:17:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279168   8 58417 62267029 A  ERROR'
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:17:47 [DEBUG   ] spawn_process: at 2018-10-26 17:17:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:18:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:18:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:18:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 17:18:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:18:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 17:18:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:18:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:18:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:18:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:18:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:18:03 [DEBUG   ] Finished updating board flags in 1.038 seconds
2018-10-26 17:18:04 [DEBUG   ] Got command BAM from MCS: ref #279169
2018-10-26 17:18:04 [INFO    ] Finished processing BAM request
2018-10-26 17:18:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:18:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279169   8 58417 62284033 A  ERROR'
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:18:04 [DEBUG   ] spawn_process: at 2018-10-26 17:18:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:18:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:18:30 [DEBUG   ] Got command BAM from MCS: ref #279170
2018-10-26 17:18:30 [INFO    ] Finished processing BAM request
2018-10-26 17:18:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279170   8 58417 62310033 A  ERROR'
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:18:30 [DEBUG   ] spawn_process: at 2018-10-26 17:18:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:18:39 [DEBUG   ] Got command RPT from MCS: ref #279171
2018-10-26 17:18:39 [DEBUG   ] summary = ERROR
2018-10-26 17:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279171  13 58417 62319033 A  ERRORERROR'
2018-10-26 17:18:39 [DEBUG   ] Got command RPT from MCS: ref #279172
2018-10-26 17:18:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279172  77 58417 62319237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:18:39 [DEBUG   ] Got command RPT from MCS: ref #279173
2018-10-26 17:18:39 [DEBUG   ] summary = ERROR
2018-10-26 17:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279173  13 58417 62319441 A  ERRORERROR'
2018-10-26 17:18:39 [DEBUG   ] Got command RPT from MCS: ref #279174
2018-10-26 17:18:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279174  77 58417 62319633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:18:39 [DEBUG   ] Got command RPT from MCS: ref #279175
2018-10-26 17:18:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 17:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279175  12 58417 62319837 A  ERRORB¢ff'
2018-10-26 17:18:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:18:43 [DEBUG   ] Got command BAM from MCS: ref #279176
2018-10-26 17:18:43 [INFO    ] Finished processing BAM request
2018-10-26 17:18:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:18:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279176   8 58417 62323033 A  ERROR'
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:18:43 [DEBUG   ] spawn_process: at 2018-10-26 17:18:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:19:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:19:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:19:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 17:19:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:19:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:19:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:19:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:19:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:19:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:19:03 [DEBUG   ] Finished updating board flags in 1.023 seconds
2018-10-26 17:19:13 [DEBUG   ] Got command BAM from MCS: ref #279177
2018-10-26 17:19:13 [INFO    ] Finished processing BAM request
2018-10-26 17:19:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:19:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279177   8 58417 62353029 A  ERROR'
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:19:13 [DEBUG   ] spawn_process: at 2018-10-26 17:19:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:19:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:19:22 [DEBUG   ] Got command BAM from MCS: ref #279178
2018-10-26 17:19:22 [INFO    ] Finished processing BAM request
2018-10-26 17:19:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:19:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279178   8 58417 62362033 A  ERROR'
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:19:22 [DEBUG   ] spawn_process: at 2018-10-26 17:19:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:19:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:19:56 [DEBUG   ] Got command BAM from MCS: ref #279179
2018-10-26 17:19:56 [INFO    ] Finished processing BAM request
2018-10-26 17:19:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:19:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279179   8 58417 62396034 A  ERROR'
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:19:56 [DEBUG   ] spawn_process: at 2018-10-26 17:19:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:20:00 [DEBUG   ] Got command BAM from MCS: ref #279184
2018-10-26 17:20:00 [INFO    ] Finished processing BAM request
2018-10-26 17:20:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279184   8 58417 62400034 A  ERROR'
2018-10-26 17:20:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:20:00 [DEBUG   ] spawn_process: at 2018-10-26 17:20:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:20:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 17:20:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 17:20:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-26 17:20:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:20:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:20:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:20:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:20:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:20:03 [WARNING ] (13, 1, 'bot')
2018-10-26 17:20:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:20:03 [DEBUG   ] Finished updating board flags in 0.938 seconds
2018-10-26 17:20:20 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-26 17:20:37 [DEBUG   ] Got command RPT from MCS: ref #279186
2018-10-26 17:20:37 [DEBUG   ] summary = ERROR
2018-10-26 17:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279186  13 58417 62437461 A  ERRORERROR'
2018-10-26 17:20:37 [DEBUG   ] Got command RPT from MCS: ref #279187
2018-10-26 17:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279187  77 58417 62437462 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:20:38 [DEBUG   ] Got command BAM from MCS: ref #279185
2018-10-26 17:20:38 [INFO    ] Finished processing BAM request
2018-10-26 17:20:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:20:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279185   8 58417 62438029 A  ERROR'
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:20:38 [DEBUG   ] spawn_process: at 2018-10-26 17:20:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:20:39 [DEBUG   ] Got command BAM from MCS: ref #279203
2018-10-26 17:20:39 [INFO    ] Finished processing BAM request
2018-10-26 17:20:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279203   8 58417 62439029 A  ERROR'
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:20:39 [DEBUG   ] spawn_process: at 2018-10-26 17:20:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:20:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 17:21:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 17:21:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:21:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:21:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:21:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:21:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:21:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:21:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:21:04 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-10-26 17:21:16 [DEBUG   ] Got command BAM from MCS: ref #279204
2018-10-26 17:21:16 [INFO    ] Finished processing BAM request
2018-10-26 17:21:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:21:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279204   8 58417 62476033 A  ERROR'
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:21:16 [DEBUG   ] spawn_process: at 2018-10-26 17:21:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:21:21 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-10-26 17:21:22 [DEBUG   ] Got command BAM from MCS: ref #279205
2018-10-26 17:21:22 [INFO    ] Finished processing BAM request
2018-10-26 17:21:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:21:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279205   8 58417 62482029 A  ERROR'
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:21:22 [DEBUG   ] spawn_process: at 2018-10-26 17:21:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:21:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:21:54 [DEBUG   ] Got command BAM from MCS: ref #279206
2018-10-26 17:21:54 [INFO    ] Finished processing BAM request
2018-10-26 17:21:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:21:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279206   8 58417 62514025 A  ERROR'
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:21:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:21:54 [DEBUG   ] spawn_process: at 2018-10-26 17:21:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:22:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:22:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 17:22:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 17:22:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:22:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:22:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:22:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:22:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:22:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:22:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:22:04 [DEBUG   ] Finished updating board flags in 1.183 seconds
2018-10-26 17:22:05 [DEBUG   ] Got command BAM from MCS: ref #279207
2018-10-26 17:22:05 [INFO    ] Finished processing BAM request
2018-10-26 17:22:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:22:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279207   8 58417 62525029 A  ERROR'
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:22:05 [DEBUG   ] spawn_process: at 2018-10-26 17:22:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:22:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:22:32 [DEBUG   ] Got command BAM from MCS: ref #279208
2018-10-26 17:22:32 [INFO    ] Finished processing BAM request
2018-10-26 17:22:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279208   8 58417 62552033 A  ERROR'
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:22:32 [DEBUG   ] spawn_process: at 2018-10-26 17:22:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:22:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 17:22:48 [DEBUG   ] Got command BAM from MCS: ref #279209
2018-10-26 17:22:48 [INFO    ] Finished processing BAM request
2018-10-26 17:22:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:22:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279209   8 58417 62568033 A  ERROR'
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:22:48 [DEBUG   ] spawn_process: at 2018-10-26 17:22:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:23:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:23:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:23:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:23:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:23:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:23:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:23:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:23:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:23:04 [DEBUG   ] Finished updating board flags in 1.003 seconds
2018-10-26 17:23:10 [DEBUG   ] Got command BAM from MCS: ref #279214
2018-10-26 17:23:10 [INFO    ] Finished processing BAM request
2018-10-26 17:23:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:23:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279214   8 58417 62590029 A  ERROR'
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:23:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:23:10 [DEBUG   ] spawn_process: at 2018-10-26 17:23:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:23:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:23:31 [DEBUG   ] Got command BAM from MCS: ref #279217
2018-10-26 17:23:31 [INFO    ] Finished processing BAM request
2018-10-26 17:23:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279217   8 58417 62611033 A  ERROR'
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:23:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:23:31 [DEBUG   ] spawn_process: at 2018-10-26 17:23:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:23:39 [DEBUG   ] Got command RPT from MCS: ref #279218
2018-10-26 17:23:39 [DEBUG   ] summary = ERROR
2018-10-26 17:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279218  13 58417 62619121 A  ERRORERROR'
2018-10-26 17:23:39 [DEBUG   ] Got command RPT from MCS: ref #279219
2018-10-26 17:23:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279219  77 58417 62619325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:23:39 [DEBUG   ] Got command RPT from MCS: ref #279220
2018-10-26 17:23:39 [DEBUG   ] summary = ERROR
2018-10-26 17:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279220  13 58417 62619517 A  ERRORERROR'
2018-10-26 17:23:39 [DEBUG   ] Got command RPT from MCS: ref #279222
2018-10-26 17:23:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279222  77 58417 62619721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:23:39 [DEBUG   ] Got command RPT from MCS: ref #279223
2018-10-26 17:23:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 17:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279223  12 58417 62619925 A  ERRORB¢ff'
2018-10-26 17:23:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 17:23:47 [DEBUG   ] Got command BAM from MCS: ref #279228
2018-10-26 17:23:47 [INFO    ] Finished processing BAM request
2018-10-26 17:23:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:23:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279228   8 58417 62627033 A  ERROR'
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:23:47 [DEBUG   ] spawn_process: at 2018-10-26 17:23:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:24:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:24:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-26 17:24:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:24:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 17:24:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:24:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 17:24:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:24:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:24:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:24:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:24:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:24:04 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-10-26 17:24:14 [DEBUG   ] Got command BAM from MCS: ref #279229
2018-10-26 17:24:14 [INFO    ] Finished processing BAM request
2018-10-26 17:24:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:24:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279229   8 58417 62654025 A  ERROR'
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:24:14 [DEBUG   ] spawn_process: at 2018-10-26 17:24:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:24:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:24:24 [DEBUG   ] Got command BAM from MCS: ref #279230
2018-10-26 17:24:24 [INFO    ] Finished processing BAM request
2018-10-26 17:24:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:24:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279230   8 58417 62664026 A  ERROR'
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:24:24 [DEBUG   ] spawn_process: at 2018-10-26 17:24:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:24:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:24:56 [DEBUG   ] Got command BAM from MCS: ref #279231
2018-10-26 17:24:56 [INFO    ] Finished processing BAM request
2018-10-26 17:24:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:24:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279231   8 58417 62696033 A  ERROR'
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:24:56 [DEBUG   ] spawn_process: at 2018-10-26 17:24:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:25:01 [DEBUG   ] Got command BAM from MCS: ref #279232
2018-10-26 17:25:01 [INFO    ] Finished processing BAM request
2018-10-26 17:25:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:25:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279232   8 58417 62701033 A  ERROR'
2018-10-26 17:25:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:25:01 [DEBUG   ] spawn_process: at 2018-10-26 17:25:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:25:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 17:25:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-26 17:25:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:25:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:25:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:25:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:25:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:25:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:25:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:25:04 [DEBUG   ] Finished updating board flags in 0.985 seconds
2018-10-26 17:25:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:25:37 [DEBUG   ] Got command RPT from MCS: ref #279235
2018-10-26 17:25:37 [DEBUG   ] summary = ERROR
2018-10-26 17:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279235  13 58417 62737461 A  ERRORERROR'
2018-10-26 17:25:37 [DEBUG   ] Got command RPT from MCS: ref #279236
2018-10-26 17:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279236  77 58417 62737462 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:25:38 [DEBUG   ] Got command BAM from MCS: ref #279233
2018-10-26 17:25:38 [INFO    ] Finished processing BAM request
2018-10-26 17:25:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:25:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279233   8 58417 62738029 A  ERROR'
2018-10-26 17:25:38 [DEBUG   ] Got command BAM from MCS: ref #279234
2018-10-26 17:25:38 [INFO    ] Finished processing BAM request
2018-10-26 17:25:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:25:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279234   8 58417 62738033 A  ERROR'
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:25:38 [DEBUG   ] spawn_process: at 2018-10-26 17:25:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:25:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:26:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:26:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 17:26:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:26:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:26:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:26:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:26:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:26:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:26:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:26:05 [DEBUG   ] Finished updating board flags in 1.851 seconds
2018-10-26 17:26:15 [DEBUG   ] Got command BAM from MCS: ref #279256
2018-10-26 17:26:15 [INFO    ] Finished processing BAM request
2018-10-26 17:26:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:26:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279256   8 58417 62775029 A  ERROR'
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:26:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:26:15 [DEBUG   ] spawn_process: at 2018-10-26 17:26:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:26:20 [DEBUG   ] Got command BAM from MCS: ref #279257
2018-10-26 17:26:20 [INFO    ] Finished processing BAM request
2018-10-26 17:26:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:26:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279257   8 58417 62780029 A  ERROR'
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:26:20 [DEBUG   ] spawn_process: at 2018-10-26 17:26:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:26:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 17:26:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:26:52 [DEBUG   ] Got command BAM from MCS: ref #279258
2018-10-26 17:26:52 [INFO    ] Finished processing BAM request
2018-10-26 17:26:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:26:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279258   8 58417 62812029 A  ERROR'
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:26:52 [DEBUG   ] spawn_process: at 2018-10-26 17:26:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:27:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:27:02 [DEBUG   ] Got command BAM from MCS: ref #279259
2018-10-26 17:27:02 [INFO    ] Finished processing BAM request
2018-10-26 17:27:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279259   8 58417 62822033 A  ERROR'
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:27:02 [DEBUG   ] spawn_process: at 2018-10-26 17:27:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:27:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:27:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 17:27:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:27:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:27:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:27:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:27:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:27:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:27:04 [DEBUG   ] Finished updating board flags in 1.196 seconds
2018-10-26 17:27:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:27:29 [DEBUG   ] Got command BAM from MCS: ref #279260
2018-10-26 17:27:29 [INFO    ] Finished processing BAM request
2018-10-26 17:27:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279260   8 58417 62849033 A  ERROR'
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:27:29 [DEBUG   ] spawn_process: at 2018-10-26 17:27:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:27:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:27:44 [DEBUG   ] Got command BAM from MCS: ref #279261
2018-10-26 17:27:44 [INFO    ] Finished processing BAM request
2018-10-26 17:27:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:27:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279261   8 58417 62864029 A  ERROR'
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:27:44 [DEBUG   ] spawn_process: at 2018-10-26 17:27:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:28:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:28:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 17:28:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 17:28:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-26 17:28:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:28:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:28:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:28:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:28:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:28:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:28:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:28:04 [DEBUG   ] Finished updating board flags in 1.065 seconds
2018-10-26 17:28:05 [DEBUG   ] Got command BAM from MCS: ref #279262
2018-10-26 17:28:05 [INFO    ] Finished processing BAM request
2018-10-26 17:28:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:28:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279262   8 58417 62885033 A  ERROR'
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:28:05 [DEBUG   ] spawn_process: at 2018-10-26 17:28:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:28:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:28:26 [DEBUG   ] Got command BAM from MCS: ref #279263
2018-10-26 17:28:26 [INFO    ] Finished processing BAM request
2018-10-26 17:28:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279263   8 58417 62906033 A  ERROR'
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:28:26 [DEBUG   ] spawn_process: at 2018-10-26 17:28:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:28:39 [DEBUG   ] Got command RPT from MCS: ref #279264
2018-10-26 17:28:39 [DEBUG   ] summary = ERROR
2018-10-26 17:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279264  13 58417 62919209 A  ERRORERROR'
2018-10-26 17:28:39 [DEBUG   ] Got command RPT from MCS: ref #279265
2018-10-26 17:28:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279265  77 58417 62919401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:28:39 [DEBUG   ] Got command RPT from MCS: ref #279266
2018-10-26 17:28:39 [DEBUG   ] summary = ERROR
2018-10-26 17:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279266  13 58417 62919605 A  ERRORERROR'
2018-10-26 17:28:39 [DEBUG   ] Got command RPT from MCS: ref #279267
2018-10-26 17:28:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279267  77 58417 62919809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:28:40 [DEBUG   ] Got command RPT from MCS: ref #279268
2018-10-26 17:28:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 17:28:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279268  12 58417 62920001 A  ERRORB¢ff'
2018-10-26 17:28:41 [DEBUG   ] Got command BAM from MCS: ref #279269
2018-10-26 17:28:41 [INFO    ] Finished processing BAM request
2018-10-26 17:28:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:28:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279269   8 58417 62921025 A  ERROR'
2018-10-26 17:28:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:28:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:28:41 [DEBUG   ] spawn_process: at 2018-10-26 17:28:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:29:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:29:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-26 17:29:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:29:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:29:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 17:29:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:29:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:29:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:29:04 [WARNING ] (13, 1, 'bot')
2018-10-26 17:29:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:29:04 [DEBUG   ] Finished updating board flags in 0.984 seconds
2018-10-26 17:29:08 [DEBUG   ] Got command BAM from MCS: ref #279274
2018-10-26 17:29:08 [INFO    ] Finished processing BAM request
2018-10-26 17:29:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:29:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279274   8 58417 62948029 A  ERROR'
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:29:08 [DEBUG   ] spawn_process: at 2018-10-26 17:29:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:29:17 [DEBUG   ] Got command BAM from MCS: ref #279275
2018-10-26 17:29:17 [INFO    ] Finished processing BAM request
2018-10-26 17:29:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:29:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279275   8 58417 62957029 A  ERROR'
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:29:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:29:17 [DEBUG   ] spawn_process: at 2018-10-26 17:29:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:29:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:29:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:29:50 [DEBUG   ] Got command BAM from MCS: ref #279276
2018-10-26 17:29:50 [INFO    ] Finished processing BAM request
2018-10-26 17:29:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:29:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279276   8 58417 62990029 A  ERROR'
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:29:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:29:50 [DEBUG   ] spawn_process: at 2018-10-26 17:29:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:29:53 [DEBUG   ] Got command BAM from MCS: ref #279277
2018-10-26 17:29:53 [INFO    ] Finished processing BAM request
2018-10-26 17:29:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:29:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279277   8 58417 62993033 A  ERROR'
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:29:53 [DEBUG   ] spawn_process: at 2018-10-26 17:29:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:30:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:30:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-26 17:30:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:30:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 17:30:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-26 17:30:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:30:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:30:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:30:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:30:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:30:05 [DEBUG   ] Finished updating board flags in 1.347 seconds
2018-10-26 17:30:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:30:29 [DEBUG   ] Got command BAM from MCS: ref #279278
2018-10-26 17:30:29 [INFO    ] Finished processing BAM request
2018-10-26 17:30:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:30:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279278   8 58417 63029029 A  ERROR'
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:30:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:30:30 [DEBUG   ] spawn_process: at 2018-10-26 17:30:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:30:32 [DEBUG   ] Got command BAM from MCS: ref #279279
2018-10-26 17:30:32 [INFO    ] Finished processing BAM request
2018-10-26 17:30:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:30:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279279   8 58417 63032025 A  ERROR'
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:30:32 [DEBUG   ] spawn_process: at 2018-10-26 17:30:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:30:37 [DEBUG   ] Got command RPT from MCS: ref #279280
2018-10-26 17:30:37 [DEBUG   ] summary = ERROR
2018-10-26 17:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279280  13 58417 63037461 A  ERRORERROR'
2018-10-26 17:30:37 [DEBUG   ] Got command RPT from MCS: ref #279281
2018-10-26 17:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279281  77 58417 63037462 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:30:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:31:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:31:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 17:31:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:31:05 [DEBUG   ] Got command BAM from MCS: ref #279297
2018-10-26 17:31:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279297   8 58417 63065025 A  ERROR'
2018-10-26 17:31:05 [INFO    ] Finished processing BAM request
2018-10-26 17:31:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:31:05 [DEBUG   ] spawn_process: at 2018-10-26 17:31:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:31:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:31:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:31:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:31:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:31:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:31:05 [DEBUG   ] Finished updating board flags in 1.733 seconds
2018-10-26 17:31:14 [DEBUG   ] Got command BAM from MCS: ref #279298
2018-10-26 17:31:14 [INFO    ] Finished processing BAM request
2018-10-26 17:31:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:31:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279298   8 58417 63074033 A  ERROR'
2018-10-26 17:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:31:14 [DEBUG   ] spawn_process: at 2018-10-26 17:31:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:31:15 [DEBUG   ] spawn_process: at 2018-10-26 17:31:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:31:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:31:41 [DEBUG   ] Got command BAM from MCS: ref #279299
2018-10-26 17:31:41 [INFO    ] Finished processing BAM request
2018-10-26 17:31:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:31:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279299   8 58417 63101033 A  ERROR'
2018-10-26 17:31:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:31:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:31:41 [DEBUG   ] spawn_process: at 2018-10-26 17:31:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:31:56 [DEBUG   ] Got command BAM from MCS: ref #279300
2018-10-26 17:31:56 [INFO    ] Finished processing BAM request
2018-10-26 17:31:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:31:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279300   8 58417 63116025 A  ERROR'
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:31:56 [DEBUG   ] spawn_process: at 2018-10-26 17:31:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:32:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 17:32:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-26 17:32:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:32:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:32:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:32:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:32:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:32:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:32:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:32:05 [DEBUG   ] Finished updating board flags in 1.093 seconds
2018-10-26 17:32:16 [DEBUG   ] Got command BAM from MCS: ref #279305
2018-10-26 17:32:16 [INFO    ] Finished processing BAM request
2018-10-26 17:32:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:32:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279305   8 58417 63136029 A  ERROR'
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:32:16 [DEBUG   ] spawn_process: at 2018-10-26 17:32:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:32:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:32:37 [DEBUG   ] Got command BAM from MCS: ref #279306
2018-10-26 17:32:37 [INFO    ] Finished processing BAM request
2018-10-26 17:32:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:32:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279306   8 58417 63157025 A  ERROR'
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:32:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:32:37 [DEBUG   ] spawn_process: at 2018-10-26 17:32:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:32:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:32:51 [DEBUG   ] Got command BAM from MCS: ref #279307
2018-10-26 17:32:51 [INFO    ] Finished processing BAM request
2018-10-26 17:32:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:32:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279307   8 58417 63171033 A  ERROR'
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:32:51 [DEBUG   ] spawn_process: at 2018-10-26 17:32:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:33:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 17:33:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:33:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 17:33:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 17:33:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:33:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:33:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:33:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:33:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:33:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:33:06 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-10-26 17:33:18 [DEBUG   ] Got command BAM from MCS: ref #279310
2018-10-26 17:33:18 [INFO    ] Finished processing BAM request
2018-10-26 17:33:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279310   8 58417 63198025 A  ERROR'
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:33:18 [DEBUG   ] spawn_process: at 2018-10-26 17:33:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:33:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:33:26 [DEBUG   ] Got command BAM from MCS: ref #279311
2018-10-26 17:33:26 [INFO    ] Finished processing BAM request
2018-10-26 17:33:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279311   8 58417 63206033 A  ERROR'
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:33:26 [DEBUG   ] spawn_process: at 2018-10-26 17:33:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:33:39 [DEBUG   ] Got command RPT from MCS: ref #279312
2018-10-26 17:33:39 [DEBUG   ] summary = ERROR
2018-10-26 17:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279312  13 58417 63219293 A  ERRORERROR'
2018-10-26 17:33:39 [DEBUG   ] Got command RPT from MCS: ref #279313
2018-10-26 17:33:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279313  77 58417 63219485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:33:39 [DEBUG   ] Got command RPT from MCS: ref #279314
2018-10-26 17:33:39 [DEBUG   ] summary = ERROR
2018-10-26 17:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279314  13 58417 63219689 A  ERRORERROR'
2018-10-26 17:33:39 [DEBUG   ] Got command RPT from MCS: ref #279316
2018-10-26 17:33:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279316  77 58417 63219897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:33:40 [DEBUG   ] Got command RPT from MCS: ref #279317
2018-10-26 17:33:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 17:33:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279317  12 58417 63220097 A  ERRORB¢ff'
2018-10-26 17:33:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 17:33:59 [DEBUG   ] Got command BAM from MCS: ref #279322
2018-10-26 17:33:59 [INFO    ] Finished processing BAM request
2018-10-26 17:33:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:33:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279322   8 58417 63239025 A  ERROR'
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:33:59 [DEBUG   ] spawn_process: at 2018-10-26 17:33:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:34:01 [DEBUG   ] Got command BAM from MCS: ref #279323
2018-10-26 17:34:01 [INFO    ] Finished processing BAM request
2018-10-26 17:34:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279323   8 58417 63241033 A  ERROR'
2018-10-26 17:34:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:34:01 [DEBUG   ] spawn_process: at 2018-10-26 17:34:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:34:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 17:34:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 17:34:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:34:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:34:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:34:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:34:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:34:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:34:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:34:05 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-10-26 17:34:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:34:36 [DEBUG   ] Got command BAM from MCS: ref #279324
2018-10-26 17:34:36 [INFO    ] Finished processing BAM request
2018-10-26 17:34:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:34:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279324   8 58417 63276029 A  ERROR'
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:34:36 [DEBUG   ] spawn_process: at 2018-10-26 17:34:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:34:40 [DEBUG   ] Got command BAM from MCS: ref #279325
2018-10-26 17:34:40 [INFO    ] Finished processing BAM request
2018-10-26 17:34:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:34:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279325   8 58417 63280025 A  ERROR'
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:34:40 [DEBUG   ] spawn_process: at 2018-10-26 17:34:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:34:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 17:35:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 17:35:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:35:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:35:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:35:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:35:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:35:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:35:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:35:06 [DEBUG   ] Finished updating board flags in 1.915 seconds
2018-10-26 17:35:11 [DEBUG   ] Got command BAM from MCS: ref #279330
2018-10-26 17:35:11 [INFO    ] Finished processing BAM request
2018-10-26 17:35:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:35:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279330   8 58417 63311033 A  ERROR'
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:35:11 [DEBUG   ] spawn_process: at 2018-10-26 17:35:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:35:21 [DEBUG   ] Got command BAM from MCS: ref #279331
2018-10-26 17:35:21 [INFO    ] Finished processing BAM request
2018-10-26 17:35:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:35:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279331   8 58417 63321025 A  ERROR'
2018-10-26 17:35:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:35:21 [DEBUG   ] spawn_process: at 2018-10-26 17:35:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:35:37 [DEBUG   ] Got command RPT from MCS: ref #279332
2018-10-26 17:35:37 [DEBUG   ] summary = ERROR
2018-10-26 17:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279332  13 58417 63337465 A  ERRORERROR'
2018-10-26 17:35:37 [DEBUG   ] Got command RPT from MCS: ref #279333
2018-10-26 17:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279333  77 58417 63337466 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:35:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:35:46 [DEBUG   ] Got command BAM from MCS: ref #279349
2018-10-26 17:35:46 [INFO    ] Finished processing BAM request
2018-10-26 17:35:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:35:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279349   8 58417 63346033 A  ERROR'
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:35:46 [DEBUG   ] spawn_process: at 2018-10-26 17:35:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:36:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 17:36:02 [DEBUG   ] Got command BAM from MCS: ref #279350
2018-10-26 17:36:02 [INFO    ] Finished processing BAM request
2018-10-26 17:36:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:36:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279350   8 58417 63362025 A  ERROR'
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:36:02 [DEBUG   ] spawn_process: at 2018-10-26 17:36:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:36:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 17:36:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:36:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 17:36:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:36:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:36:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:36:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:36:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:36:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:36:05 [DEBUG   ] Finished updating board flags in 1.078 seconds
2018-10-26 17:36:20 [DEBUG   ] Got command BAM from MCS: ref #279351
2018-10-26 17:36:20 [INFO    ] Finished processing BAM request
2018-10-26 17:36:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:36:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279351   8 58417 63380033 A  ERROR'
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:36:20 [DEBUG   ] spawn_process: at 2018-10-26 17:36:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:36:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 17:36:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:36:43 [DEBUG   ] Got command BAM from MCS: ref #279352
2018-10-26 17:36:43 [INFO    ] Finished processing BAM request
2018-10-26 17:36:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279352   8 58417 63403025 A  ERROR'
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:36:43 [DEBUG   ] spawn_process: at 2018-10-26 17:36:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:36:54 [DEBUG   ] Got command BAM from MCS: ref #279353
2018-10-26 17:36:54 [INFO    ] Finished processing BAM request
2018-10-26 17:36:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279353   8 58417 63414025 A  ERROR'
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:36:54 [DEBUG   ] spawn_process: at 2018-10-26 17:36:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:37:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 17:37:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:37:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 17:37:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-26 17:37:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:37:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:37:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:37:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:37:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:37:05 [DEBUG   ] Finished updating board flags in 1.033 seconds
2018-10-26 17:37:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:37:24 [DEBUG   ] Got command BAM from MCS: ref #279354
2018-10-26 17:37:24 [INFO    ] Finished processing BAM request
2018-10-26 17:37:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279354   8 58417 63444033 A  ERROR'
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:37:24 [DEBUG   ] spawn_process: at 2018-10-26 17:37:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:37:28 [DEBUG   ] Got command BAM from MCS: ref #279355
2018-10-26 17:37:28 [INFO    ] Finished processing BAM request
2018-10-26 17:37:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:37:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279355   8 58417 63448025 A  ERROR'
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:37:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:37:28 [DEBUG   ] spawn_process: at 2018-10-26 17:37:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:37:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:38:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 17:38:02 [DEBUG   ] Got command BAM from MCS: ref #279360
2018-10-26 17:38:02 [INFO    ] Finished processing BAM request
2018-10-26 17:38:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:38:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279360   8 58417 63482029 A  ERROR'
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:38:02 [DEBUG   ] spawn_process: at 2018-10-26 17:38:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:38:05 [DEBUG   ] Got command BAM from MCS: ref #279361
2018-10-26 17:38:05 [INFO    ] Finished processing BAM request
2018-10-26 17:38:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:38:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279361   8 58417 63485025 A  ERROR'
2018-10-26 17:38:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 17:38:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 17:38:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:38:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-26 17:38:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:38:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:38:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:38:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:38:05 [WARNING ] (13, 1, 'bot')
2018-10-26 17:38:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:38:05 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:38:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:38:05 [DEBUG   ] spawn_process: at 2018-10-26 17:38:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:38:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:38:36 [DEBUG   ] Got command BAM from MCS: ref #279362
2018-10-26 17:38:36 [INFO    ] Finished processing BAM request
2018-10-26 17:38:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279362   8 58417 63516025 A  ERROR'
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:38:36 [DEBUG   ] spawn_process: at 2018-10-26 17:38:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:38:39 [DEBUG   ] Got command RPT from MCS: ref #279363
2018-10-26 17:38:39 [DEBUG   ] summary = ERROR
2018-10-26 17:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279363  13 58417 63519373 A  ERRORERROR'
2018-10-26 17:38:39 [DEBUG   ] Got command RPT from MCS: ref #279364
2018-10-26 17:38:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279364  77 58417 63519577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:38:39 [DEBUG   ] Got command RPT from MCS: ref #279365
2018-10-26 17:38:39 [DEBUG   ] summary = ERROR
2018-10-26 17:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279365  13 58417 63519781 A  ERRORERROR'
2018-10-26 17:38:39 [DEBUG   ] Got command RPT from MCS: ref #279366
2018-10-26 17:38:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279366  77 58417 63519973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:38:40 [DEBUG   ] Got command RPT from MCS: ref #279367
2018-10-26 17:38:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 17:38:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279367  12 58417 63520177 A  ERRORB¢ff'
2018-10-26 17:38:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:38:46 [DEBUG   ] Got command BAM from MCS: ref #279368
2018-10-26 17:38:46 [INFO    ] Finished processing BAM request
2018-10-26 17:38:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:38:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279368   8 58417 63526025 A  ERROR'
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:38:46 [DEBUG   ] spawn_process: at 2018-10-26 17:38:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:39:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 17:39:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 17:39:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-26 17:39:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:39:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 17:39:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:39:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:39:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:39:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:39:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:39:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:39:06 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-10-26 17:39:10 [DEBUG   ] Got command BAM from MCS: ref #279369
2018-10-26 17:39:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:39:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279369   8 58417 63550350 A  ERROR'
2018-10-26 17:39:10 [INFO    ] Finished processing BAM request
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:39:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:39:10 [DEBUG   ] spawn_process: at 2018-10-26 17:39:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:39:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:39:27 [DEBUG   ] Got command BAM from MCS: ref #279370
2018-10-26 17:39:27 [INFO    ] Finished processing BAM request
2018-10-26 17:39:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:39:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279370   8 58417 63567034 A  ERROR'
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:39:27 [DEBUG   ] spawn_process: at 2018-10-26 17:39:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:39:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:39:44 [DEBUG   ] Got command BAM from MCS: ref #279371
2018-10-26 17:39:44 [INFO    ] Finished processing BAM request
2018-10-26 17:39:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:39:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279371   8 58417 63584033 A  ERROR'
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:39:44 [DEBUG   ] spawn_process: at 2018-10-26 17:39:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:40:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 17:40:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 17:40:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:40:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 17:40:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 17:40:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:40:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:40:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:40:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:40:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:40:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:40:06 [DEBUG   ] Finished updating board flags in 1.500 seconds
2018-10-26 17:40:08 [DEBUG   ] Got command BAM from MCS: ref #279372
2018-10-26 17:40:08 [INFO    ] Finished processing BAM request
2018-10-26 17:40:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:40:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279372   8 58417 63608033 A  ERROR'
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:40:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:40:08 [DEBUG   ] spawn_process: at 2018-10-26 17:40:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:40:18 [DEBUG   ] Got command BAM from MCS: ref #279373
2018-10-26 17:40:18 [INFO    ] Finished processing BAM request
2018-10-26 17:40:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:40:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279373   8 58417 63618029 A  ERROR'
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:40:18 [DEBUG   ] spawn_process: at 2018-10-26 17:40:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:40:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:40:37 [DEBUG   ] Got command RPT from MCS: ref #279374
2018-10-26 17:40:37 [DEBUG   ] summary = ERROR
2018-10-26 17:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279374  13 58417 63637469 A  ERRORERROR'
2018-10-26 17:40:37 [DEBUG   ] Got command RPT from MCS: ref #279375
2018-10-26 17:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279375  77 58417 63637470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:40:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:40:49 [DEBUG   ] Got command BAM from MCS: ref #279391
2018-10-26 17:40:49 [INFO    ] Finished processing BAM request
2018-10-26 17:40:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279391   8 58417 63649033 A  ERROR'
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:40:49 [DEBUG   ] spawn_process: at 2018-10-26 17:40:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:40:51 [DEBUG   ] Got command BAM from MCS: ref #279392
2018-10-26 17:40:51 [INFO    ] Finished processing BAM request
2018-10-26 17:40:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:40:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279392   8 58417 63651033 A  ERROR'
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:40:51 [DEBUG   ] spawn_process: at 2018-10-26 17:40:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:41:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 17:41:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2018-10-26 17:41:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 17:41:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:41:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:41:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:41:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:41:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:41:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:41:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:41:06 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-26 17:41:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:41:24 [DEBUG   ] Got command BAM from MCS: ref #279397
2018-10-26 17:41:24 [INFO    ] Finished processing BAM request
2018-10-26 17:41:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:41:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279397   8 58417 63684025 A  ERROR'
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:41:24 [DEBUG   ] spawn_process: at 2018-10-26 17:41:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:41:29 [DEBUG   ] Got command BAM from MCS: ref #279398
2018-10-26 17:41:29 [INFO    ] Finished processing BAM request
2018-10-26 17:41:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:41:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279398   8 58417 63689033 A  ERROR'
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:41:29 [DEBUG   ] spawn_process: at 2018-10-26 17:41:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:41:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:41:57 [DEBUG   ] Got command BAM from MCS: ref #279399
2018-10-26 17:41:57 [INFO    ] Finished processing BAM request
2018-10-26 17:41:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:41:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279399   8 58417 63717029 A  ERROR'
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:41:57 [DEBUG   ] spawn_process: at 2018-10-26 17:41:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:42:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 17:42:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:42:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:42:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:42:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:42:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:42:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:42:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:42:06 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-26 17:42:09 [DEBUG   ] Got command BAM from MCS: ref #279400
2018-10-26 17:42:09 [INFO    ] Finished processing BAM request
2018-10-26 17:42:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:42:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279400   8 58417 63729025 A  ERROR'
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:42:09 [DEBUG   ] spawn_process: at 2018-10-26 17:42:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:42:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:42:30 [DEBUG   ] Got command BAM from MCS: ref #279401
2018-10-26 17:42:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279401   8 58417 63750294 A  ERROR'
2018-10-26 17:42:30 [INFO    ] Finished processing BAM request
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:42:30 [DEBUG   ] spawn_process: at 2018-10-26 17:42:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:42:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:42:49 [DEBUG   ] Got command BAM from MCS: ref #279402
2018-10-26 17:42:49 [INFO    ] Finished processing BAM request
2018-10-26 17:42:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:42:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279402   8 58417 63769030 A  ERROR'
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:42:49 [DEBUG   ] spawn_process: at 2018-10-26 17:42:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:43:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 17:43:03 [DEBUG   ] Got command BAM from MCS: ref #279403
2018-10-26 17:43:03 [INFO    ] Finished processing BAM request
2018-10-26 17:43:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:43:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279403   8 58417 63783029 A  ERROR'
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:43:03 [DEBUG   ] spawn_process: at 2018-10-26 17:43:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:43:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:43:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-26 17:43:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:43:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:43:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:43:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:43:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:43:06 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-10-26 17:43:21 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 17:43:29 [DEBUG   ] Got command BAM from MCS: ref #279406
2018-10-26 17:43:29 [INFO    ] Finished processing BAM request
2018-10-26 17:43:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279406   8 58417 63809025 A  ERROR'
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:43:29 [DEBUG   ] spawn_process: at 2018-10-26 17:43:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:43:36 [DEBUG   ] Got command BAM from MCS: ref #279407
2018-10-26 17:43:36 [INFO    ] Finished processing BAM request
2018-10-26 17:43:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:43:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279407   8 58417 63816025 A  ERROR'
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:43:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:43:36 [DEBUG   ] spawn_process: at 2018-10-26 17:43:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:43:39 [DEBUG   ] Got command RPT from MCS: ref #279408
2018-10-26 17:43:39 [DEBUG   ] summary = ERROR
2018-10-26 17:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279408  13 58417 63819453 A  ERRORERROR'
2018-10-26 17:43:39 [DEBUG   ] Got command RPT from MCS: ref #279409
2018-10-26 17:43:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279409  77 58417 63819657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:43:39 [DEBUG   ] Got command RPT from MCS: ref #279410
2018-10-26 17:43:39 [DEBUG   ] summary = ERROR
2018-10-26 17:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279410  13 58417 63819861 A  ERRORERROR'
2018-10-26 17:43:40 [DEBUG   ] Got command RPT from MCS: ref #279412
2018-10-26 17:43:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:43:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279412  77 58417 63820065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:43:40 [DEBUG   ] Got command RPT from MCS: ref #279414
2018-10-26 17:43:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 17:43:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279414  12 58417 63820257 A  ERRORB¡ff'
2018-10-26 17:43:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:44:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 17:44:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:44:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:44:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:44:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:44:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:44:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:44:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:44:06 [DEBUG   ] Finished updating board flags in 1.202 seconds
2018-10-26 17:44:09 [DEBUG   ] Got command BAM from MCS: ref #279422
2018-10-26 17:44:09 [INFO    ] Finished processing BAM request
2018-10-26 17:44:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:44:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279422   8 58417 63849029 A  ERROR'
2018-10-26 17:44:09 [DEBUG   ] Got command BAM from MCS: ref #279423
2018-10-26 17:44:09 [INFO    ] Finished processing BAM request
2018-10-26 17:44:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:44:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279423   8 58417 63849033 A  ERROR'
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:44:09 [DEBUG   ] spawn_process: at 2018-10-26 17:44:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:44:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:44:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:44:42 [DEBUG   ] Got command BAM from MCS: ref #279424
2018-10-26 17:44:42 [INFO    ] Finished processing BAM request
2018-10-26 17:44:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:44:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279424   8 58417 63882033 A  ERROR'
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:44:42 [DEBUG   ] spawn_process: at 2018-10-26 17:44:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:44:49 [DEBUG   ] Got command BAM from MCS: ref #279425
2018-10-26 17:44:49 [INFO    ] Finished processing BAM request
2018-10-26 17:44:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:44:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279425   8 58417 63889033 A  ERROR'
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:44:49 [DEBUG   ] spawn_process: at 2018-10-26 17:44:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:45:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 17:45:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 17:45:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:45:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:45:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 17:45:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:45:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:45:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:45:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:45:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:45:06 [DEBUG   ] Finished updating board flags in 1.219 seconds
2018-10-26 17:45:14 [DEBUG   ] Got command BAM from MCS: ref #279426
2018-10-26 17:45:14 [INFO    ] Finished processing BAM request
2018-10-26 17:45:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:45:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279426   8 58417 63914033 A  ERROR'
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:45:14 [DEBUG   ] spawn_process: at 2018-10-26 17:45:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:45:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:45:29 [DEBUG   ] Got command BAM from MCS: ref #279427
2018-10-26 17:45:29 [INFO    ] Finished processing BAM request
2018-10-26 17:45:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:45:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279427   8 58417 63929029 A  ERROR'
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:45:29 [DEBUG   ] spawn_process: at 2018-10-26 17:45:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:45:37 [DEBUG   ] Got command RPT from MCS: ref #279428
2018-10-26 17:45:37 [DEBUG   ] summary = ERROR
2018-10-26 17:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279428  13 58417 63937469 A  ERRORERROR'
2018-10-26 17:45:37 [DEBUG   ] Got command RPT from MCS: ref #279429
2018-10-26 17:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279429  77 58417 63937470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:45:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:45:46 [DEBUG   ] Got command BAM from MCS: ref #279445
2018-10-26 17:45:46 [INFO    ] Finished processing BAM request
2018-10-26 17:45:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:45:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279445   8 58417 63946025 A  ERROR'
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:45:46 [DEBUG   ] spawn_process: at 2018-10-26 17:45:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:46:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 17:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 17:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 17:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 17:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 17:46:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 17:46:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 17:46:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:46:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:46:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:46:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:46:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:46:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:46:06 [DEBUG   ] Finished updating board flags in 1.199 seconds
2018-10-26 17:46:09 [DEBUG   ] Got command BAM from MCS: ref #279446
2018-10-26 17:46:09 [INFO    ] Finished processing BAM request
2018-10-26 17:46:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:46:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279446   8 58417 63969025 A  ERROR'
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:46:09 [DEBUG   ] spawn_process: at 2018-10-26 17:46:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:46:18 [DEBUG   ] Got command BAM from MCS: ref #279447
2018-10-26 17:46:18 [INFO    ] Finished processing BAM request
2018-10-26 17:46:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:46:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279447   8 58417 63978029 A  ERROR'
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:46:18 [DEBUG   ] spawn_process: at 2018-10-26 17:46:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:46:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:46:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 17:46:49 [DEBUG   ] Got command BAM from MCS: ref #279448
2018-10-26 17:46:49 [INFO    ] Finished processing BAM request
2018-10-26 17:46:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:46:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279448   8 58417 64009029 A  ERROR'
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:46:49 [DEBUG   ] spawn_process: at 2018-10-26 17:46:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:46:50 [DEBUG   ] Got command BAM from MCS: ref #279449
2018-10-26 17:46:50 [INFO    ] Finished processing BAM request
2018-10-26 17:46:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:46:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279449   8 58417 64010033 A  ERROR'
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:46:50 [DEBUG   ] spawn_process: at 2018-10-26 17:46:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:47:01 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-26 17:47:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 17:47:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:47:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:47:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:47:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:47:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:47:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:47:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:47:06 [DEBUG   ] Finished updating board flags in 0.999 seconds
2018-10-26 17:47:22 [DEBUG   ] Got command BAM from MCS: ref #279454
2018-10-26 17:47:22 [INFO    ] Finished processing BAM request
2018-10-26 17:47:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:47:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279454   8 58417 64042025 A  ERROR'
2018-10-26 17:47:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:47:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:47:22 [DEBUG   ] spawn_process: at 2018-10-26 17:47:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:47:29 [DEBUG   ] Got command BAM from MCS: ref #279455
2018-10-26 17:47:29 [INFO    ] Finished processing BAM request
2018-10-26 17:47:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279455   8 58417 64049025 A  ERROR'
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:47:29 [DEBUG   ] spawn_process: at 2018-10-26 17:47:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:47:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:47:54 [DEBUG   ] Got command BAM from MCS: ref #279456
2018-10-26 17:47:54 [INFO    ] Finished processing BAM request
2018-10-26 17:47:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:47:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279456   8 58417 64074025 A  ERROR'
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:47:54 [DEBUG   ] spawn_process: at 2018-10-26 17:47:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:48:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 17:48:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:48:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:48:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:48:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:48:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:48:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:48:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:48:06 [DEBUG   ] Finished updating board flags in 1.270 seconds
2018-10-26 17:48:09 [DEBUG   ] Got command BAM from MCS: ref #279457
2018-10-26 17:48:09 [INFO    ] Finished processing BAM request
2018-10-26 17:48:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:48:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279457   8 58417 64089025 A  ERROR'
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:48:09 [DEBUG   ] spawn_process: at 2018-10-26 17:48:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:48:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:48:26 [DEBUG   ] Got command BAM from MCS: ref #279458
2018-10-26 17:48:26 [INFO    ] Finished processing BAM request
2018-10-26 17:48:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279458   8 58417 64106030 A  ERROR'
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:48:26 [DEBUG   ] spawn_process: at 2018-10-26 17:48:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:48:39 [DEBUG   ] Got command RPT from MCS: ref #279459
2018-10-26 17:48:39 [DEBUG   ] summary = ERROR
2018-10-26 17:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279459  13 58417 64119541 A  ERRORERROR'
2018-10-26 17:48:39 [DEBUG   ] Got command RPT from MCS: ref #279460
2018-10-26 17:48:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279460  77 58417 64119745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:48:39 [DEBUG   ] Got command RPT from MCS: ref #279461
2018-10-26 17:48:39 [DEBUG   ] summary = ERROR
2018-10-26 17:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279461  13 58417 64119949 A  ERRORERROR'
2018-10-26 17:48:40 [DEBUG   ] Got command RPT from MCS: ref #279462
2018-10-26 17:48:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:48:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279462  77 58417 64120142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:48:40 [DEBUG   ] Got command RPT from MCS: ref #279463
2018-10-26 17:48:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 17:48:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279463  12 58417 64120345 A  ERRORB¢ff'
2018-10-26 17:48:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:48:49 [DEBUG   ] Got command BAM from MCS: ref #279464
2018-10-26 17:48:49 [INFO    ] Finished processing BAM request
2018-10-26 17:48:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:48:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279464   8 58417 64129026 A  ERROR'
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:48:49 [DEBUG   ] spawn_process: at 2018-10-26 17:48:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:48:58 [DEBUG   ] Got command BAM from MCS: ref #279465
2018-10-26 17:48:58 [INFO    ] Finished processing BAM request
2018-10-26 17:48:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:48:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279465   8 58417 64138030 A  ERROR'
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:48:58 [DEBUG   ] spawn_process: at 2018-10-26 17:48:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:49:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:49:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 17:49:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 17:49:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:49:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:49:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:49:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:49:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:49:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:49:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:49:06 [DEBUG   ] Finished updating board flags in 1.172 seconds
2018-10-26 17:49:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:49:29 [DEBUG   ] Got command BAM from MCS: ref #279466
2018-10-26 17:49:29 [INFO    ] Finished processing BAM request
2018-10-26 17:49:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279466   8 58417 64169030 A  ERROR'
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:49:29 [DEBUG   ] spawn_process: at 2018-10-26 17:49:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:49:30 [DEBUG   ] Got command BAM from MCS: ref #279467
2018-10-26 17:49:30 [INFO    ] Finished processing BAM request
2018-10-26 17:49:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:49:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279467   8 58417 64170029 A  ERROR'
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:49:30 [DEBUG   ] spawn_process: at 2018-10-26 17:49:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:49:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:50:01 [DEBUG   ] Got command BAM from MCS: ref #279472
2018-10-26 17:50:01 [INFO    ] Finished processing BAM request
2018-10-26 17:50:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:50:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279472   8 58417 64201029 A  ERROR'
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:50:01 [DEBUG   ] spawn_process: at 2018-10-26 17:50:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:50:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:50:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 17:50:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 17:50:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-26 17:50:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:50:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 17:50:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:50:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:50:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:50:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:50:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:50:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:50:06 [DEBUG   ] Finished updating board flags in 1.017 seconds
2018-10-26 17:50:09 [DEBUG   ] Got command BAM from MCS: ref #279473
2018-10-26 17:50:09 [INFO    ] Finished processing BAM request
2018-10-26 17:50:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:50:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279473   8 58417 64209033 A  ERROR'
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:50:09 [DEBUG   ] spawn_process: at 2018-10-26 17:50:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:50:22 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 17:50:32 [DEBUG   ] Got command BAM from MCS: ref #279474
2018-10-26 17:50:32 [INFO    ] Finished processing BAM request
2018-10-26 17:50:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:50:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279474   8 58417 64232037 A  ERROR'
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:50:32 [DEBUG   ] spawn_process: at 2018-10-26 17:50:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:50:37 [DEBUG   ] Got command RPT from MCS: ref #279475
2018-10-26 17:50:37 [DEBUG   ] summary = ERROR
2018-10-26 17:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279475  13 58417 64237473 A  ERRORERROR'
2018-10-26 17:50:37 [DEBUG   ] Got command RPT from MCS: ref #279476
2018-10-26 17:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279476  77 58417 64237474 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:50:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:50:48 [DEBUG   ] Got command BAM from MCS: ref #279492
2018-10-26 17:50:48 [INFO    ] Finished processing BAM request
2018-10-26 17:50:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279492   8 58417 64248029 A  ERROR'
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:50:48 [DEBUG   ] spawn_process: at 2018-10-26 17:50:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:51:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:51:03 [DEBUG   ] Got command BAM from MCS: ref #279493
2018-10-26 17:51:03 [INFO    ] Finished processing BAM request
2018-10-26 17:51:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:51:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279493   8 58417 64263025 A  ERROR'
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:51:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:51:03 [DEBUG   ] spawn_process: at 2018-10-26 17:51:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:51:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 17:51:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 17:51:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:51:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:51:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:51:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:51:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:51:06 [WARNING ] (13, 1, 'bot')
2018-10-26 17:51:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:51:06 [DEBUG   ] Finished updating board flags in 0.983 seconds
2018-10-26 17:51:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:51:27 [DEBUG   ] Got command BAM from MCS: ref #279494
2018-10-26 17:51:27 [INFO    ] Finished processing BAM request
2018-10-26 17:51:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:51:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279494   8 58417 64287029 A  ERROR'
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:51:27 [DEBUG   ] spawn_process: at 2018-10-26 17:51:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:51:34 [DEBUG   ] Got command BAM from MCS: ref #279495
2018-10-26 17:51:34 [INFO    ] Finished processing BAM request
2018-10-26 17:51:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:51:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279495   8 58417 64294034 A  ERROR'
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:51:34 [DEBUG   ] spawn_process: at 2018-10-26 17:51:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:51:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:52:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 17:52:05 [DEBUG   ] Got command BAM from MCS: ref #279496
2018-10-26 17:52:05 [INFO    ] Finished processing BAM request
2018-10-26 17:52:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:52:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279496   8 58417 64325034 A  ERROR'
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:52:05 [DEBUG   ] spawn_process: at 2018-10-26 17:52:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:52:06 [DEBUG   ] Got command BAM from MCS: ref #279497
2018-10-26 17:52:06 [INFO    ] Finished processing BAM request
2018-10-26 17:52:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:52:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279497   8 58417 64326034 A  ERROR'
2018-10-26 17:52:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 17:52:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-26 17:52:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:52:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:52:06 [DEBUG   ] spawn_process: at 2018-10-26 17:52:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:52:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:52:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:52:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:52:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:52:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:52:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:52:07 [DEBUG   ] Finished updating board flags in 1.379 seconds
2018-10-26 17:52:22 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-10-26 17:52:36 [DEBUG   ] Got command BAM from MCS: ref #279498
2018-10-26 17:52:36 [INFO    ] Finished processing BAM request
2018-10-26 17:52:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:52:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279498   8 58417 64356033 A  ERROR'
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:52:36 [DEBUG   ] spawn_process: at 2018-10-26 17:52:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:52:42 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-26 17:52:45 [DEBUG   ] Got command BAM from MCS: ref #279499
2018-10-26 17:52:45 [INFO    ] Finished processing BAM request
2018-10-26 17:52:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:52:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279499   8 58417 64365029 A  ERROR'
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:52:45 [DEBUG   ] spawn_process: at 2018-10-26 17:52:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:53:03 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 17:53:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 17:53:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:53:07 [DEBUG   ] Got command BAM from MCS: ref #279504
2018-10-26 17:53:07 [INFO    ] Finished processing BAM request
2018-10-26 17:53:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:53:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279504   8 58417 64387033 A  ERROR'
2018-10-26 17:53:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-26 17:53:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 17:53:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:53:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:53:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:53:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:53:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:53:07 [DEBUG   ] Finished updating board flags in 1.262 seconds
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:53:07 [DEBUG   ] spawn_process: at 2018-10-26 17:53:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:53:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 17:53:24 [DEBUG   ] Got command BAM from MCS: ref #279507
2018-10-26 17:53:24 [INFO    ] Finished processing BAM request
2018-10-26 17:53:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279507   8 58417 64404033 A  ERROR'
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:53:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:53:24 [DEBUG   ] spawn_process: at 2018-10-26 17:53:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:53:38 [DEBUG   ] Got command BAM from MCS: ref #279508
2018-10-26 17:53:38 [INFO    ] Finished processing BAM request
2018-10-26 17:53:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:53:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279508   8 58417 64418029 A  ERROR'
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:53:38 [DEBUG   ] spawn_process: at 2018-10-26 17:53:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:53:39 [DEBUG   ] Got command RPT from MCS: ref #279509
2018-10-26 17:53:39 [DEBUG   ] summary = ERROR
2018-10-26 17:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279509  13 58417 64419621 A  ERRORERROR'
2018-10-26 17:53:39 [DEBUG   ] Got command RPT from MCS: ref #279510
2018-10-26 17:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279510  77 58417 64419825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:53:40 [DEBUG   ] Got command RPT from MCS: ref #279511
2018-10-26 17:53:40 [DEBUG   ] summary = ERROR
2018-10-26 17:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279511  13 58417 64420029 A  ERRORERROR'
2018-10-26 17:53:40 [DEBUG   ] Got command RPT from MCS: ref #279513
2018-10-26 17:53:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279513  77 58417 64420233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:53:40 [DEBUG   ] Got command RPT from MCS: ref #279514
2018-10-26 17:53:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 17:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279514  12 58417 64420425 A  ERRORB¡ff'
2018-10-26 17:53:43 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 17:54:03 [DEBUG   ] Got command BAM from MCS: ref #279519
2018-10-26 17:54:03 [INFO    ] Finished processing BAM request
2018-10-26 17:54:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:54:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279519   8 58417 64443029 A  ERROR'
2018-10-26 17:54:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:54:03 [DEBUG   ] spawn_process: at 2018-10-26 17:54:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:54:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:54:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:54:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:54:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:54:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:54:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:54:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:54:07 [DEBUG   ] Finished updating board flags in 1.217 seconds
2018-10-26 17:54:09 [DEBUG   ] Got command BAM from MCS: ref #279520
2018-10-26 17:54:09 [INFO    ] Finished processing BAM request
2018-10-26 17:54:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:54:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279520   8 58417 64449033 A  ERROR'
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 17:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 17:54:09 [DEBUG   ] spawn_process: at 2018-10-26 17:54:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 17:54:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 17:54:40 [DEBUG   ] Got command BAM from MCS: ref #279521
2018-10-26 17:54:40 [INFO    ] Finished processing BAM request
2018-10-26 17:54:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:54:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279521   8 58417 64480033 A  ERROR'
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:54:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:54:40 [DEBUG   ] spawn_process: at 2018-10-26 17:54:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:54:42 [DEBUG   ] Got command BAM from MCS: ref #279522
2018-10-26 17:54:42 [INFO    ] Finished processing BAM request
2018-10-26 17:54:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:54:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279522   8 58417 64482029 A  ERROR'
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:54:42 [DEBUG   ] spawn_process: at 2018-10-26 17:54:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:54:43 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-26 17:55:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 17:55:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 17:55:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:55:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:55:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:55:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:55:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:55:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:55:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:55:07 [DEBUG   ] Finished updating board flags in 1.116 seconds
2018-10-26 17:55:10 [DEBUG   ] Got command BAM from MCS: ref #279523
2018-10-26 17:55:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:55:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279523   8 58417 64510033 A  ERROR'
2018-10-26 17:55:10 [INFO    ] Finished processing BAM request
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:55:10 [DEBUG   ] spawn_process: at 2018-10-26 17:55:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:55:21 [DEBUG   ] Got command BAM from MCS: ref #279524
2018-10-26 17:55:21 [INFO    ] Finished processing BAM request
2018-10-26 17:55:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:55:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279524   8 58417 64521033 A  ERROR'
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:55:21 [DEBUG   ] spawn_process: at 2018-10-26 17:55:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:55:24 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 17:55:37 [DEBUG   ] Got command RPT from MCS: ref #279525
2018-10-26 17:55:37 [DEBUG   ] summary = ERROR
2018-10-26 17:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279525  13 58417 64537473 A  ERRORERROR'
2018-10-26 17:55:37 [DEBUG   ] Got command RPT from MCS: ref #279526
2018-10-26 17:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279526  77 58417 64537474 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:55:40 [DEBUG   ] Got command BAM from MCS: ref #279542
2018-10-26 17:55:40 [INFO    ] Finished processing BAM request
2018-10-26 17:55:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279542   8 58417 64540033 A  ERROR'
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:55:40 [DEBUG   ] spawn_process: at 2018-10-26 17:55:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:55:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 17:56:00 [DEBUG   ] Got command BAM from MCS: ref #279547
2018-10-26 17:56:00 [INFO    ] Finished processing BAM request
2018-10-26 17:56:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:56:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279547   8 58417 64560033 A  ERROR'
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:56:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:56:00 [DEBUG   ] spawn_process: at 2018-10-26 17:56:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:56:04 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 17:56:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:56:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:56:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:56:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:56:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:56:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:56:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:56:07 [DEBUG   ] Finished updating board flags in 0.998 seconds
2018-10-26 17:56:10 [DEBUG   ] Got command BAM from MCS: ref #279548
2018-10-26 17:56:10 [INFO    ] Finished processing BAM request
2018-10-26 17:56:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:56:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279548   8 58417 64570029 A  ERROR'
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:56:10 [DEBUG   ] spawn_process: at 2018-10-26 17:56:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:56:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:56:39 [DEBUG   ] Got command BAM from MCS: ref #279549
2018-10-26 17:56:39 [INFO    ] Finished processing BAM request
2018-10-26 17:56:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279549   8 58417 64599029 A  ERROR'
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:56:39 [DEBUG   ] spawn_process: at 2018-10-26 17:56:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:56:40 [DEBUG   ] Got command BAM from MCS: ref #279550
2018-10-26 17:56:40 [INFO    ] Finished processing BAM request
2018-10-26 17:56:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279550   8 58417 64600029 A  ERROR'
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:56:40 [DEBUG   ] spawn_process: at 2018-10-26 17:56:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:56:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:57:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:57:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:57:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2018-10-26 17:57:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 17:57:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:57:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:57:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:57:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:57:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:57:07 [DEBUG   ] Finished updating board flags in 1.260 seconds
2018-10-26 17:57:10 [DEBUG   ] Got command BAM from MCS: ref #279551
2018-10-26 17:57:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279551   8 58417 64630029 A  ERROR'
2018-10-26 17:57:10 [INFO    ] Finished processing BAM request
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:57:10 [DEBUG   ] spawn_process: at 2018-10-26 17:57:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:57:18 [DEBUG   ] Got command BAM from MCS: ref #279552
2018-10-26 17:57:18 [INFO    ] Finished processing BAM request
2018-10-26 17:57:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:57:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279552   8 58417 64638025 A  ERROR'
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:57:18 [DEBUG   ] spawn_process: at 2018-10-26 17:57:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:57:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:57:40 [DEBUG   ] Got command BAM from MCS: ref #279553
2018-10-26 17:57:40 [INFO    ] Finished processing BAM request
2018-10-26 17:57:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279553   8 58417 64660025 A  ERROR'
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:57:40 [DEBUG   ] spawn_process: at 2018-10-26 17:57:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:57:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:57:57 [DEBUG   ] Got command BAM from MCS: ref #279554
2018-10-26 17:57:57 [INFO    ] Finished processing BAM request
2018-10-26 17:57:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:57:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279554   8 58417 64677029 A  ERROR'
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:57:57 [DEBUG   ] spawn_process: at 2018-10-26 17:57:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:58:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:58:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 17:58:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:58:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 17:58:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 17:58:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 17:58:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:58:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:58:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:58:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:58:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:58:07 [DEBUG   ] Finished updating board flags in 1.176 seconds
2018-10-26 17:58:10 [DEBUG   ] Got command BAM from MCS: ref #279555
2018-10-26 17:58:10 [INFO    ] Finished processing BAM request
2018-10-26 17:58:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:58:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279555   8 58417 64690029 A  ERROR'
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 17:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 17:58:10 [DEBUG   ] spawn_process: at 2018-10-26 17:58:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 17:58:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:58:36 [DEBUG   ] Got command BAM from MCS: ref #279556
2018-10-26 17:58:36 [INFO    ] Finished processing BAM request
2018-10-26 17:58:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279556   8 58417 64716029 A  ERROR'
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:58:36 [DEBUG   ] spawn_process: at 2018-10-26 17:58:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:58:39 [DEBUG   ] Got command RPT from MCS: ref #279558
2018-10-26 17:58:39 [DEBUG   ] summary = ERROR
2018-10-26 17:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279558  13 58417 64719713 A  ERRORERROR'
2018-10-26 17:58:39 [DEBUG   ] Got command RPT from MCS: ref #279559
2018-10-26 17:58:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279559  77 58417 64719917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:58:40 [DEBUG   ] Got command BAM from MCS: ref #279557
2018-10-26 17:58:40 [INFO    ] Finished processing BAM request
2018-10-26 17:58:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279557   8 58417 64720029 A  ERROR'
2018-10-26 17:58:40 [DEBUG   ] Got command RPT from MCS: ref #279560
2018-10-26 17:58:40 [DEBUG   ] summary = ERROR
2018-10-26 17:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279560  13 58417 64720113 A  ERRORERROR'
2018-10-26 17:58:40 [DEBUG   ] Got command RPT from MCS: ref #279561
2018-10-26 17:58:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 17:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279561  77 58417 64720317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 17:58:40 [DEBUG   ] Got command RPT from MCS: ref #279562
2018-10-26 17:58:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 17:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279562  12 58417 64720521 A  ERRORB£ff'
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 17:58:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 17:58:40 [DEBUG   ] spawn_process: at 2018-10-26 17:58:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 17:58:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 17:59:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 17:59:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 17:59:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 17:59:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-26 17:59:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 17:59:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:59:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:59:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:59:07 [WARNING ] (13, 1, 'bot')
2018-10-26 17:59:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 17:59:07 [DEBUG   ] Finished updating board flags in 1.027 seconds
2018-10-26 17:59:10 [DEBUG   ] Got command BAM from MCS: ref #279567
2018-10-26 17:59:10 [INFO    ] Finished processing BAM request
2018-10-26 17:59:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:59:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279567   8 58417 64750033 A  ERROR'
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:59:10 [DEBUG   ] spawn_process: at 2018-10-26 17:59:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:59:15 [DEBUG   ] Got command BAM from MCS: ref #279568
2018-10-26 17:59:15 [INFO    ] Finished processing BAM request
2018-10-26 17:59:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:59:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279568   8 58417 64755029 A  ERROR'
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:59:15 [DEBUG   ] spawn_process: at 2018-10-26 17:59:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 17:59:24 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 17:59:40 [DEBUG   ] Got command BAM from MCS: ref #279569
2018-10-26 17:59:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:59:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279569   8 58417 64780142 A  ERROR'
2018-10-26 17:59:40 [INFO    ] Finished processing BAM request
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 17:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 17:59:40 [DEBUG   ] spawn_process: at 2018-10-26 17:59:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 17:59:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 17:59:54 [DEBUG   ] Got command BAM from MCS: ref #279570
2018-10-26 17:59:54 [INFO    ] Finished processing BAM request
2018-10-26 17:59:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 17:59:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   279570   8 58417 64794030 A  ERROR'
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 17:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 17:59:54 [DEBUG   ] spawn_process: at 2018-10-26 17:59:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 18:00:00 [DEBUG   ] Got command STP from MCS: ref #279571
2018-10-26 18:00:00 [INFO    ] Finished processing BAM request
2018-10-26 18:00:00 [INFO    ] Shutdown the adder chain on beam #3
2018-10-26 18:00:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   279571   8 58417 64800033 A  ERROR'
2018-10-26 18:00:00 [DEBUG   ] Got command STP from MCS: ref #279572
2018-10-26 18:00:00 [INFO    ] Finished processing BAM request
2018-10-26 18:00:00 [INFO    ] Shutdown the adder chain on beam #4
2018-10-26 18:00:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   279572   8 58417 64800037 A  ERROR'
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 18:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 18:00:00 [DEBUG   ] spawn_process: at 2018-10-26 18:00:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 18:00:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 18:00:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:00:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 18:00:07 [WARNING ] (13, 1, 'bot')
2018-10-26 18:00:07 [WARNING ] (13, 1, 'bot')
2018-10-26 18:00:07 [WARNING ] (13, 1, 'bot')
2018-10-26 18:00:07 [WARNING ] (13, 1, 'bot')
2018-10-26 18:00:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:00:07 [DEBUG   ] Finished updating board flags in 0.974 seconds
2018-10-26 18:00:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 18:00:37 [DEBUG   ] Got command RPT from MCS: ref #279573
2018-10-26 18:00:37 [DEBUG   ] summary = ERROR
2018-10-26 18:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279573  13 58417 64837469 A  ERRORERROR'
2018-10-26 18:00:37 [DEBUG   ] Got command RPT from MCS: ref #279574
2018-10-26 18:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279574  77 58417 64837470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:00:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 18:01:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 18:01:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:01:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:01:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:01:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:01:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:01:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:01:08 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-10-26 18:01:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 18:01:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 18:02:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 18:02:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:02:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:02:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:02:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:02:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:02:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:02:08 [DEBUG   ] Finished updating board flags in 1.254 seconds
2018-10-26 18:02:24 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 18:02:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 18:03:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 18:03:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:03:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:03:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:03:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:03:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:03:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:03:08 [DEBUG   ] Finished updating board flags in 1.132 seconds
2018-10-26 18:03:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 18:03:39 [DEBUG   ] Got command RPT from MCS: ref #279596
2018-10-26 18:03:39 [DEBUG   ] summary = ERROR
2018-10-26 18:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279596  13 58417 65019801 A  ERRORERROR'
2018-10-26 18:03:40 [DEBUG   ] Got command RPT from MCS: ref #279597
2018-10-26 18:03:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:03:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279597  77 58417 65020005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:03:40 [DEBUG   ] Got command RPT from MCS: ref #279598
2018-10-26 18:03:40 [DEBUG   ] summary = ERROR
2018-10-26 18:03:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279598  13 58417 65020197 A  ERRORERROR'
2018-10-26 18:03:40 [DEBUG   ] Got command RPT from MCS: ref #279600
2018-10-26 18:03:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:03:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279600  77 58417 65020401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:03:40 [DEBUG   ] Got command RPT from MCS: ref #279601
2018-10-26 18:03:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 18:03:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279601  12 58417 65020605 A  ERRORBš™š'
2018-10-26 18:03:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 18:04:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 18:04:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:04:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:04:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:04:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:04:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:04:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:04:08 [DEBUG   ] Finished updating board flags in 1.022 seconds
2018-10-26 18:04:24 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-26 18:04:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 18:05:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 18:05:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:05:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:05:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:05:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:05:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:05:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:05:08 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-10-26 18:05:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:05:37 [DEBUG   ] Got command RPT from MCS: ref #279610
2018-10-26 18:05:37 [DEBUG   ] summary = ERROR
2018-10-26 18:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279610  13 58417 65137469 A  ERRORERROR'
2018-10-26 18:05:37 [DEBUG   ] Got command RPT from MCS: ref #279611
2018-10-26 18:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279611  77 58417 65137470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:05:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:06:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:06:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:06:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:06:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:06:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:06:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:06:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:06:08 [DEBUG   ] Finished updating board flags in 0.976 seconds
2018-10-26 18:06:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:06:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:07:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 18:07:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:07:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:07:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:07:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:07:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:07:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:07:09 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-10-26 18:07:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 18:07:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:08:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:08:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:08:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:08:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:08:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:08:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:08:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:08:08 [DEBUG   ] Finished updating board flags in 1.231 seconds
2018-10-26 18:08:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:08:39 [DEBUG   ] Got command RPT from MCS: ref #279631
2018-10-26 18:08:39 [DEBUG   ] summary = ERROR
2018-10-26 18:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279631  13 58417 65319894 A  ERRORERROR'
2018-10-26 18:08:40 [DEBUG   ] Got command RPT from MCS: ref #279632
2018-10-26 18:08:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279632  77 58417 65320086 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:08:40 [DEBUG   ] Got command RPT from MCS: ref #279633
2018-10-26 18:08:40 [DEBUG   ] summary = ERROR
2018-10-26 18:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279633  13 58417 65320289 A  ERRORERROR'
2018-10-26 18:08:40 [DEBUG   ] Got command RPT from MCS: ref #279634
2018-10-26 18:08:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279634  77 58417 65320493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:08:40 [DEBUG   ] Got command RPT from MCS: ref #279635
2018-10-26 18:08:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 18:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279635  12 58417 65320686 A  ERRORB˜™š'
2018-10-26 18:08:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:09:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:09:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:09:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:09:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:09:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:09:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:09:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:09:08 [DEBUG   ] Finished updating board flags in 1.295 seconds
2018-10-26 18:09:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:09:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:10:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 18:10:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:10:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 18:10:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 18:10:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:10:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:10:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:10:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:10:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:10:08 [DEBUG   ] Finished updating board flags in 1.145 seconds
2018-10-26 18:10:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 18:10:37 [DEBUG   ] Got command RPT from MCS: ref #279636
2018-10-26 18:10:37 [DEBUG   ] summary = ERROR
2018-10-26 18:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279636  13 58417 65437469 A  ERRORERROR'
2018-10-26 18:10:37 [DEBUG   ] Got command RPT from MCS: ref #279637
2018-10-26 18:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279637  77 58417 65437470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:10:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:11:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:11:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:11:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-10-26 18:11:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:11:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:11:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:11:08 [WARNING ] (13, 1, 'bot')
2018-10-26 18:11:08 [WARNING ] (25, 5, 'bot')
2018-10-26 18:11:08 [WARNING ] (25, 5, 'bot')
2018-10-26 18:11:08 [WARNING ] (25, 5, 'bot')
2018-10-26 18:11:08 [WARNING ] (25, 5, 'bot')
2018-10-26 18:11:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:11:08 [DEBUG   ] Finished updating board flags in 1.030 seconds
2018-10-26 18:11:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:11:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:12:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:12:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:12:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:12:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:12:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:12:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:12:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:12:09 [DEBUG   ] Finished updating board flags in 1.538 seconds
2018-10-26 18:12:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:12:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:13:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:13:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:13:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:13:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:13:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:13:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:13:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:13:09 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-26 18:13:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:13:39 [DEBUG   ] Got command RPT from MCS: ref #279659
2018-10-26 18:13:39 [DEBUG   ] summary = ERROR
2018-10-26 18:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279659  13 58417 65619977 A  ERRORERROR'
2018-10-26 18:13:40 [DEBUG   ] Got command RPT from MCS: ref #279660
2018-10-26 18:13:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:13:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279660  77 58417 65620169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:13:40 [DEBUG   ] Got command RPT from MCS: ref #279661
2018-10-26 18:13:40 [DEBUG   ] summary = ERROR
2018-10-26 18:13:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279661  13 58417 65620377 A  ERRORERROR'
2018-10-26 18:13:40 [DEBUG   ] Got command RPT from MCS: ref #279663
2018-10-26 18:13:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:13:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279663  77 58417 65620577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:13:40 [DEBUG   ] Got command RPT from MCS: ref #279664
2018-10-26 18:13:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 18:13:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279664  12 58417 65620781 A  ERRORB—™š'
2018-10-26 18:13:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:14:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:14:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:14:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 18:14:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:14:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:14:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:14:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:14:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:14:09 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-26 18:14:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 18:14:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:15:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 18:15:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:15:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:15:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:15:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:15:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:15:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:15:09 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-10-26 18:15:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:15:37 [DEBUG   ] Got command RPT from MCS: ref #279673
2018-10-26 18:15:37 [DEBUG   ] summary = ERROR
2018-10-26 18:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279673  13 58417 65737477 A  ERRORERROR'
2018-10-26 18:15:37 [DEBUG   ] Got command RPT from MCS: ref #279674
2018-10-26 18:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279674  77 58417 65737478 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:15:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:16:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:16:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:16:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:16:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:16:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:16:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:16:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:16:09 [DEBUG   ] Finished updating board flags in 1.176 seconds
2018-10-26 18:16:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:16:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:17:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 18:17:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:17:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:17:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:17:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:17:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:17:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:17:09 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-10-26 18:17:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:17:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:18:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:18:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:18:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:18:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:18:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:18:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:18:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:18:10 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-10-26 18:18:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:18:40 [DEBUG   ] Got command RPT from MCS: ref #279694
2018-10-26 18:18:40 [DEBUG   ] summary = ERROR
2018-10-26 18:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279694  13 58417 65920057 A  ERRORERROR'
2018-10-26 18:18:40 [DEBUG   ] Got command RPT from MCS: ref #279695
2018-10-26 18:18:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279695  77 58417 65920261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:18:40 [DEBUG   ] Got command RPT from MCS: ref #279696
2018-10-26 18:18:40 [DEBUG   ] summary = ERROR
2018-10-26 18:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279696  13 58417 65920465 A  ERRORERROR'
2018-10-26 18:18:40 [DEBUG   ] Got command RPT from MCS: ref #279697
2018-10-26 18:18:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279697  77 58417 65920657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:18:40 [DEBUG   ] Got command RPT from MCS: ref #279698
2018-10-26 18:18:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 18:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279698  12 58417 65920861 A  ERRORB—™š'
2018-10-26 18:18:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 18:19:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:19:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 18:19:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:19:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 18:19:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:19:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:19:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:19:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:19:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:19:09 [DEBUG   ] Finished updating board flags in 1.257 seconds
2018-10-26 18:19:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:19:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:20:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:20:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:20:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:20:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:20:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:20:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:20:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:20:09 [DEBUG   ] Finished updating board flags in 1.264 seconds
2018-10-26 18:20:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:20:37 [DEBUG   ] Got command RPT from MCS: ref #279703
2018-10-26 18:20:37 [DEBUG   ] summary = ERROR
2018-10-26 18:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279703  13 58417 66037477 A  ERRORERROR'
2018-10-26 18:20:37 [DEBUG   ] Got command RPT from MCS: ref #279704
2018-10-26 18:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279704  77 58417 66037478 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:20:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:21:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:21:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:21:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:21:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:21:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:21:09 [WARNING ] (13, 1, 'bot')
2018-10-26 18:21:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:21:09 [DEBUG   ] Finished updating board flags in 1.113 seconds
2018-10-26 18:21:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:21:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:22:00 [DEBUG   ] Got command TBN from MCS: ref #279720
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-26 18:22:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   279720   8 58417 66120561 A  ERROR'
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540578122']
2018-10-26 18:22:00 [DEBUG   ] spawn_process: at 2018-10-26 18:22:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540578122']
2018-10-26 18:22:00 [INFO    ] Finished spawning TBN in 0.051 s
2018-10-26 18:22:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 18:22:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 18:22:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:22:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:22:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:22:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:22:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:22:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:22:10 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-10-26 18:22:25 [DEBUG   ] Finished updating ant stats in 1.068 seconds
2018-10-26 18:22:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 18:23:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 18:23:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:23:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:23:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:23:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:23:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:23:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:23:10 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-10-26 18:23:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 18:23:40 [DEBUG   ] Got command RPT from MCS: ref #279727
2018-10-26 18:23:40 [DEBUG   ] summary = ERROR
2018-10-26 18:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279727  13 58417 66220149 A  ERRORERROR'
2018-10-26 18:23:40 [DEBUG   ] Got command RPT from MCS: ref #279728
2018-10-26 18:23:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279728  77 58417 66220341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:23:40 [DEBUG   ] Got command RPT from MCS: ref #279729
2018-10-26 18:23:40 [DEBUG   ] summary = ERROR
2018-10-26 18:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279729  13 58417 66220545 A  ERRORERROR'
2018-10-26 18:23:40 [DEBUG   ] Got command RPT from MCS: ref #279731
2018-10-26 18:23:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279731  77 58417 66220749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:23:40 [DEBUG   ] Got command RPT from MCS: ref #279732
2018-10-26 18:23:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 18:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279732  12 58417 66220941 A  ERRORB˜™š'
2018-10-26 18:23:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 18:24:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 18:24:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:24:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 18:24:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:24:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:24:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:24:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:24:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:24:10 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-10-26 18:24:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 18:24:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 18:25:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 18:25:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 18:25:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:25:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 18:25:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:25:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:25:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:25:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:25:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:25:10 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-26 18:25:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 18:25:37 [DEBUG   ] Got command RPT from MCS: ref #279737
2018-10-26 18:25:37 [DEBUG   ] summary = ERROR
2018-10-26 18:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279737  13 58417 66337481 A  ERRORERROR'
2018-10-26 18:25:37 [DEBUG   ] Got command RPT from MCS: ref #279738
2018-10-26 18:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279738  77 58417 66337482 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:25:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 18:26:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 18:26:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 18:26:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:26:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:26:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:26:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:26:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:26:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:26:10 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-10-26 18:26:11 [DEBUG   ] Got command TBW from MCS: ref #279759
2018-10-26 18:26:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-10-26 18:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   279759   8 58417 66371633 A  ERROR'
2018-10-26 18:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-10-26 18:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-10-26 18:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-10-26 18:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-10-26 18:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-10-26 18:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-10-26 18:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-10-26 18:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-10-26 18:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-10-26 18:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-10-26 18:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-10-26 18:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-10-26 18:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-10-26 18:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-10-26 18:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-10-26 18:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-10-26 18:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-10-26 18:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-10-26 18:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-10-26 18:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-10-26 18:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-10-26 18:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-10-26 18:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-10-26 18:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-10-26 18:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-10-26 18:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-10-26 18:26:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-10-26 18:26:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-10-26 18:26:15 [DEBUG   ] spawn_process: at 2018-10-26 18:26:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-10-26 18:26:15 [INFO    ] Finished spawning TBW
2018-10-26 18:27:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:27:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:27:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:27:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:27:10 [WARNING ] (13, 1, 'bot')
2018-10-26 18:27:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:27:10 [DEBUG   ] Finished updating board flags in 1.279 seconds
2018-10-26 18:28:03 [INFO    ] __waitForTBW - TBW finished in 108.675 s
2018-10-26 18:28:04 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2018-10-26 18:28:04 [INFO    ] Started antennas statistics background thread
2018-10-26 18:28:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540578486']
2018-10-26 18:28:04 [DEBUG   ] spawn_process: at 2018-10-26 18:28:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540578486']
2018-10-26 18:28:04 [INFO    ] Finished spawning TBN in 0.051 s
2018-10-26 18:28:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:28:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:28:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:28:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:28:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:28:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:28:11 [DEBUG   ] Finished updating board flags in 2.250 seconds
2018-10-26 18:28:24 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2018-10-26 18:28:40 [DEBUG   ] Got command RPT from MCS: ref #279765
2018-10-26 18:28:40 [DEBUG   ] summary = ERROR
2018-10-26 18:28:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279765  13 58417 66520225 A  ERRORERROR'
2018-10-26 18:28:40 [DEBUG   ] Got command RPT from MCS: ref #279766
2018-10-26 18:28:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:28:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279766  77 58417 66520429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:28:40 [DEBUG   ] Got command RPT from MCS: ref #279767
2018-10-26 18:28:40 [DEBUG   ] summary = ERROR
2018-10-26 18:28:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279767  13 58417 66520633 A  ERRORERROR'
2018-10-26 18:28:40 [DEBUG   ] Got command RPT from MCS: ref #279768
2018-10-26 18:28:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:28:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279768  77 58417 66520837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:28:41 [DEBUG   ] Got command RPT from MCS: ref #279769
2018-10-26 18:28:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 18:28:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279769  12 58417 66521029 A  ERRORB˜™š'
2018-10-26 18:28:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 18:29:04 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-26 18:29:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:29:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:29:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:29:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:29:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:29:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:29:11 [DEBUG   ] Finished updating board flags in 2.222 seconds
2018-10-26 18:29:24 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-26 18:29:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 18:30:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 18:30:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:30:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:30:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:30:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:30:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:30:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:30:11 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-10-26 18:30:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 18:30:37 [DEBUG   ] Got command RPT from MCS: ref #279776
2018-10-26 18:30:37 [DEBUG   ] summary = ERROR
2018-10-26 18:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279776  13 58417 66637481 A  ERRORERROR'
2018-10-26 18:30:37 [DEBUG   ] Got command RPT from MCS: ref #279777
2018-10-26 18:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279777  77 58417 66637482 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:30:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 18:31:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 18:31:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:31:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:31:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:31:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:31:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:31:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:31:11 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-26 18:31:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 18:31:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 18:32:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 18:32:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:32:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:32:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:32:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:32:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:32:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:32:11 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-10-26 18:32:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 18:32:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 18:33:05 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-10-26 18:33:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:33:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:33:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:33:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:33:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:33:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:33:11 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-10-26 18:33:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:33:40 [DEBUG   ] Got command RPT from MCS: ref #279799
2018-10-26 18:33:40 [DEBUG   ] summary = ERROR
2018-10-26 18:33:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279799  13 58417 66820321 A  ERRORERROR'
2018-10-26 18:33:40 [DEBUG   ] Got command RPT from MCS: ref #279800
2018-10-26 18:33:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:33:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279800  77 58417 66820513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:33:40 [DEBUG   ] Got command RPT from MCS: ref #279801
2018-10-26 18:33:40 [DEBUG   ] summary = ERROR
2018-10-26 18:33:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279801  13 58417 66820717 A  ERRORERROR'
2018-10-26 18:33:40 [DEBUG   ] Got command RPT from MCS: ref #279803
2018-10-26 18:33:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:33:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279803  77 58417 66820921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:33:41 [DEBUG   ] Got command RPT from MCS: ref #279804
2018-10-26 18:33:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 18:33:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279804  12 58417 66821113 A  ERRORB˜™š'
2018-10-26 18:33:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 18:34:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 18:34:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:34:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:34:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:34:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:34:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:34:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:34:11 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-10-26 18:34:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 18:34:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 18:35:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:35:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:35:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:35:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:35:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:35:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:35:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:35:11 [DEBUG   ] Finished updating board flags in 1.913 seconds
2018-10-26 18:35:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 18:35:37 [DEBUG   ] Got command RPT from MCS: ref #279813
2018-10-26 18:35:37 [DEBUG   ] summary = ERROR
2018-10-26 18:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279813  13 58417 66937481 A  ERRORERROR'
2018-10-26 18:35:37 [DEBUG   ] Got command RPT from MCS: ref #279814
2018-10-26 18:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279814  77 58417 66937482 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:35:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 18:36:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 18:36:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:36:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:36:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:36:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:36:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:36:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:36:11 [DEBUG   ] Finished updating board flags in 1.685 seconds
2018-10-26 18:36:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 18:36:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 18:37:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 18:37:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 18:37:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:37:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:37:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:37:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:37:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:37:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:37:11 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-10-26 18:37:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 18:37:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 18:38:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 18:38:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:38:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:38:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:38:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:38:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:38:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:38:11 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-10-26 18:38:25 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-10-26 18:38:40 [DEBUG   ] Got command RPT from MCS: ref #279834
2018-10-26 18:38:40 [DEBUG   ] summary = ERROR
2018-10-26 18:38:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279834  13 58417 67120405 A  ERRORERROR'
2018-10-26 18:38:40 [DEBUG   ] Got command RPT from MCS: ref #279835
2018-10-26 18:38:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:38:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279835  77 58417 67120597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:38:40 [DEBUG   ] Got command RPT from MCS: ref #279836
2018-10-26 18:38:40 [DEBUG   ] summary = ERROR
2018-10-26 18:38:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279836  13 58417 67120801 A  ERRORERROR'
2018-10-26 18:38:41 [DEBUG   ] Got command RPT from MCS: ref #279837
2018-10-26 18:38:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:38:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279837  77 58417 67121005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:38:41 [DEBUG   ] Got command RPT from MCS: ref #279838
2018-10-26 18:38:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 18:38:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279838  12 58417 67121209 A  ERRORB˜™š'
2018-10-26 18:38:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 18:39:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 18:39:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:39:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:39:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:39:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:39:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:39:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:39:11 [DEBUG   ] Finished updating board flags in 1.597 seconds
2018-10-26 18:39:26 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 18:39:46 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 18:40:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 18:40:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:40:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 18:40:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:40:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:40:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:40:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:40:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:40:11 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-10-26 18:40:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 18:40:37 [DEBUG   ] Got command RPT from MCS: ref #279839
2018-10-26 18:40:37 [DEBUG   ] summary = ERROR
2018-10-26 18:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279839  13 58417 67237485 A  ERRORERROR'
2018-10-26 18:40:37 [DEBUG   ] Got command RPT from MCS: ref #279840
2018-10-26 18:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279840  77 58417 67237486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:40:46 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-26 18:41:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 18:41:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 18:41:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:41:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:41:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:41:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:41:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:41:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:41:11 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-26 18:41:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 18:41:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 18:42:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 18:42:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:42:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:42:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:42:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:42:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:42:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:42:11 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-10-26 18:42:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 18:42:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 18:43:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 18:43:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:43:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:43:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:43:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:43:11 [WARNING ] (13, 1, 'bot')
2018-10-26 18:43:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:43:11 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-10-26 18:43:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 18:43:40 [DEBUG   ] Got command RPT from MCS: ref #279862
2018-10-26 18:43:40 [DEBUG   ] summary = ERROR
2018-10-26 18:43:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279862  13 58417 67420485 A  ERRORERROR'
2018-10-26 18:43:40 [DEBUG   ] Got command RPT from MCS: ref #279863
2018-10-26 18:43:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:43:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279863  77 58417 67420689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:43:40 [DEBUG   ] Got command RPT from MCS: ref #279864
2018-10-26 18:43:40 [DEBUG   ] summary = ERROR
2018-10-26 18:43:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279864  13 58417 67420893 A  ERRORERROR'
2018-10-26 18:43:41 [DEBUG   ] Got command RPT from MCS: ref #279866
2018-10-26 18:43:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:43:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279866  77 58417 67421085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:43:41 [DEBUG   ] Got command RPT from MCS: ref #279867
2018-10-26 18:43:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 18:43:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279867  12 58417 67421289 A  ERRORB˜™š'
2018-10-26 18:43:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 18:44:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 18:44:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:44:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:44:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:44:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:44:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:44:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:44:12 [DEBUG   ] Finished updating board flags in 2.061 seconds
2018-10-26 18:44:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 18:44:46 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 18:45:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 18:45:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 18:45:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:45:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 18:45:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:45:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:45:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:45:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:45:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:45:12 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-26 18:45:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 18:45:37 [DEBUG   ] Got command RPT from MCS: ref #279876
2018-10-26 18:45:37 [DEBUG   ] summary = ERROR
2018-10-26 18:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279876  13 58417 67537485 A  ERRORERROR'
2018-10-26 18:45:37 [DEBUG   ] Got command RPT from MCS: ref #279877
2018-10-26 18:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279877  77 58417 67537486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:45:47 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 18:46:07 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 18:46:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 18:46:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:46:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:46:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:46:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:46:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:46:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:46:12 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-26 18:46:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 18:46:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 18:47:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:47:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:47:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:47:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:47:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:47:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:47:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:47:12 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-10-26 18:47:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:47:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 18:48:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 18:48:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:48:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:48:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:48:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:48:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:48:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:48:12 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-10-26 18:48:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 18:48:40 [DEBUG   ] Got command RPT from MCS: ref #279897
2018-10-26 18:48:40 [DEBUG   ] summary = ERROR
2018-10-26 18:48:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279897  13 58417 67720569 A  ERRORERROR'
2018-10-26 18:48:40 [DEBUG   ] Got command RPT from MCS: ref #279898
2018-10-26 18:48:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:48:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279898  77 58417 67720773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:48:40 [DEBUG   ] Got command RPT from MCS: ref #279899
2018-10-26 18:48:40 [DEBUG   ] summary = ERROR
2018-10-26 18:48:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279899  13 58417 67720995 A  ERRORERROR'
2018-10-26 18:48:41 [DEBUG   ] Got command RPT from MCS: ref #279900
2018-10-26 18:48:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:48:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279900  77 58417 67721173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:48:41 [DEBUG   ] Got command RPT from MCS: ref #279901
2018-10-26 18:48:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 18:48:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279901  12 58417 67721377 A  ERRORB˜™š'
2018-10-26 18:48:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 18:49:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 18:49:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:49:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:49:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:49:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:49:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:49:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:49:12 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-10-26 18:49:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 18:49:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 18:50:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 18:50:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:50:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:50:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:50:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:50:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:50:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:50:12 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-10-26 18:50:27 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-26 18:50:37 [DEBUG   ] Got command RPT from MCS: ref #279906
2018-10-26 18:50:37 [DEBUG   ] summary = ERROR
2018-10-26 18:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279906  13 58417 67837485 A  ERRORERROR'
2018-10-26 18:50:37 [DEBUG   ] Got command RPT from MCS: ref #279907
2018-10-26 18:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279907  77 58417 67837486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:50:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 18:51:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 18:51:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:51:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:51:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:51:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:51:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:51:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:51:12 [DEBUG   ] Finished updating board flags in 1.395 seconds
2018-10-26 18:51:27 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-26 18:51:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 18:52:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 18:52:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:52:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:52:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:52:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:52:12 [WARNING ] (13, 1, 'bot')
2018-10-26 18:52:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:52:12 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-10-26 18:52:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 18:52:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 18:53:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 18:53:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:53:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:53:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:53:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:53:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:53:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:53:13 [DEBUG   ] Finished updating board flags in 2.046 seconds
2018-10-26 18:53:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:53:40 [DEBUG   ] Got command RPT from MCS: ref #279929
2018-10-26 18:53:40 [DEBUG   ] summary = ERROR
2018-10-26 18:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279929  13 58417 68020661 A  ERRORERROR'
2018-10-26 18:53:40 [DEBUG   ] Got command RPT from MCS: ref #279930
2018-10-26 18:53:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279930  77 58417 68020853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:53:41 [DEBUG   ] Got command RPT from MCS: ref #279931
2018-10-26 18:53:41 [DEBUG   ] summary = ERROR
2018-10-26 18:53:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279931  13 58417 68021057 A  ERRORERROR'
2018-10-26 18:53:41 [DEBUG   ] Got command RPT from MCS: ref #279933
2018-10-26 18:53:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:53:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279933  77 58417 68021261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:53:41 [DEBUG   ] Got command RPT from MCS: ref #279935
2018-10-26 18:53:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 18:53:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279935  12 58417 68021465 A  ERRORB˜™š'
2018-10-26 18:53:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 18:54:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 18:54:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:54:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 18:54:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:54:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:54:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:54:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:54:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:54:13 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-10-26 18:54:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:54:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:55:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:55:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:55:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:55:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:55:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:55:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:55:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:55:13 [DEBUG   ] Finished updating board flags in 1.881 seconds
2018-10-26 18:55:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 18:55:37 [DEBUG   ] Got command RPT from MCS: ref #279939
2018-10-26 18:55:37 [DEBUG   ] summary = ERROR
2018-10-26 18:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279939  13 58417 68137489 A  ERRORERROR'
2018-10-26 18:55:37 [DEBUG   ] Got command RPT from MCS: ref #279940
2018-10-26 18:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279940  77 58417 68137490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:55:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 18:56:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:56:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:56:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:56:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:56:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:56:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:56:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:56:13 [DEBUG   ] Finished updating board flags in 1.840 seconds
2018-10-26 18:56:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:56:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 18:57:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 18:57:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:57:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:57:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:57:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:57:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:57:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:57:13 [DEBUG   ] Finished updating board flags in 1.703 seconds
2018-10-26 18:57:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:57:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 18:58:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 18:58:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:58:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:58:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:58:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:58:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:58:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:58:13 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-10-26 18:58:28 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 18:58:40 [DEBUG   ] Got command RPT from MCS: ref #279960
2018-10-26 18:58:40 [DEBUG   ] summary = ERROR
2018-10-26 18:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279960  13 58417 68320745 A  ERRORERROR'
2018-10-26 18:58:40 [DEBUG   ] Got command RPT from MCS: ref #279961
2018-10-26 18:58:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279961  77 58417 68320937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:58:41 [DEBUG   ] Got command RPT from MCS: ref #279962
2018-10-26 18:58:41 [DEBUG   ] summary = ERROR
2018-10-26 18:58:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279962  13 58417 68321141 A  ERRORERROR'
2018-10-26 18:58:41 [DEBUG   ] Got command RPT from MCS: ref #279963
2018-10-26 18:58:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 18:58:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279963  77 58417 68321345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 18:58:41 [DEBUG   ] Got command RPT from MCS: ref #279964
2018-10-26 18:58:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 18:58:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279964  12 58417 68321549 A  ERRORB˜™š'
2018-10-26 18:58:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 18:59:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 18:59:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 18:59:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 18:59:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:59:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:59:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:59:13 [WARNING ] (13, 1, 'bot')
2018-10-26 18:59:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 18:59:13 [DEBUG   ] Finished updating board flags in 1.562 seconds
2018-10-26 18:59:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 18:59:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 19:00:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 19:00:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:00:13 [WARNING ] (13, 1, 'bot')
2018-10-26 19:00:13 [WARNING ] (13, 1, 'bot')
2018-10-26 19:00:13 [WARNING ] (13, 1, 'bot')
2018-10-26 19:00:13 [WARNING ] (13, 1, 'bot')
2018-10-26 19:00:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:00:13 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-10-26 19:00:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 19:00:37 [DEBUG   ] Got command RPT from MCS: ref #279969
2018-10-26 19:00:37 [DEBUG   ] summary = ERROR
2018-10-26 19:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279969  13 58417 68437481 A  ERRORERROR'
2018-10-26 19:00:37 [DEBUG   ] Got command RPT from MCS: ref #279970
2018-10-26 19:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279970  77 58417 68437482 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:00:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 19:01:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 19:01:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 19:01:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:01:13 [WARNING ] (13, 1, 'bot')
2018-10-26 19:01:13 [WARNING ] (13, 1, 'bot')
2018-10-26 19:01:13 [WARNING ] (13, 1, 'bot')
2018-10-26 19:01:13 [WARNING ] (13, 1, 'bot')
2018-10-26 19:01:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:01:13 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-10-26 19:01:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 19:01:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 19:02:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 19:02:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:02:13 [WARNING ] (13, 1, 'bot')
2018-10-26 19:02:13 [WARNING ] (13, 1, 'bot')
2018-10-26 19:02:13 [WARNING ] (13, 1, 'bot')
2018-10-26 19:02:13 [WARNING ] (13, 1, 'bot')
2018-10-26 19:02:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:02:13 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-10-26 19:02:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 19:02:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 19:03:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 19:03:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:03:13 [WARNING ] (13, 1, 'bot')
2018-10-26 19:03:13 [WARNING ] (13, 1, 'bot')
2018-10-26 19:03:13 [WARNING ] (13, 1, 'bot')
2018-10-26 19:03:13 [WARNING ] (13, 1, 'bot')
2018-10-26 19:03:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:03:13 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-10-26 19:03:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 19:03:40 [DEBUG   ] Got command RPT from MCS: ref #279992
2018-10-26 19:03:40 [DEBUG   ] summary = ERROR
2018-10-26 19:03:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279992  13 58417 68620825 A  ERRORERROR'
2018-10-26 19:03:41 [DEBUG   ] Got command RPT from MCS: ref #279993
2018-10-26 19:03:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:03:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279993  77 58417 68621029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:03:41 [DEBUG   ] Got command RPT from MCS: ref #279994
2018-10-26 19:03:41 [DEBUG   ] summary = ERROR
2018-10-26 19:03:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279994  13 58417 68621233 A  ERRORERROR'
2018-10-26 19:03:41 [DEBUG   ] Got command RPT from MCS: ref #279996
2018-10-26 19:03:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:03:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279996  77 58417 68621425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:03:41 [DEBUG   ] Got command RPT from MCS: ref #279997
2018-10-26 19:03:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 19:03:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   279997  12 58417 68621629 A  ERRORB˜™š'
2018-10-26 19:03:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 19:04:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 19:04:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:04:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:04:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:04:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:04:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:04:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:04:14 [DEBUG   ] Finished updating board flags in 2.264 seconds
2018-10-26 19:04:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 19:04:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 19:05:08 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 19:05:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 19:05:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:05:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:05:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:05:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:05:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:05:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:05:14 [DEBUG   ] Finished updating board flags in 2.110 seconds
2018-10-26 19:05:29 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 19:05:37 [DEBUG   ] Got command RPT from MCS: ref #280006
2018-10-26 19:05:37 [DEBUG   ] summary = ERROR
2018-10-26 19:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280006  13 58417 68737485 A  ERRORERROR'
2018-10-26 19:05:37 [DEBUG   ] Got command RPT from MCS: ref #280007
2018-10-26 19:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280007  77 58417 68737486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:05:49 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 19:06:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 19:06:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:06:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:06:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:06:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:06:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:06:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:06:14 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-10-26 19:06:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:06:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:07:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 19:07:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:07:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:07:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:07:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:07:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:07:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:07:14 [DEBUG   ] Finished updating board flags in 1.965 seconds
2018-10-26 19:07:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 19:07:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 19:08:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 19:08:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 19:08:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:08:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:08:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:08:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:08:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:08:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:08:14 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-10-26 19:08:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 19:08:40 [DEBUG   ] Got command RPT from MCS: ref #280027
2018-10-26 19:08:40 [DEBUG   ] summary = ERROR
2018-10-26 19:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280027  13 58417 68920909 A  ERRORERROR'
2018-10-26 19:08:41 [DEBUG   ] Got command RPT from MCS: ref #280028
2018-10-26 19:08:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:08:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280028  77 58417 68921113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:08:41 [DEBUG   ] Got command RPT from MCS: ref #280029
2018-10-26 19:08:41 [DEBUG   ] summary = ERROR
2018-10-26 19:08:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280029  13 58417 68921321 A  ERRORERROR'
2018-10-26 19:08:41 [DEBUG   ] Got command RPT from MCS: ref #280030
2018-10-26 19:08:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:08:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280030  77 58417 68921513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:08:41 [DEBUG   ] Got command RPT from MCS: ref #280031
2018-10-26 19:08:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 19:08:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280031  12 58417 68921717 A  ERRORB˜™š'
2018-10-26 19:08:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 19:09:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 19:09:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:09:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 19:09:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:09:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:09:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:09:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:09:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:09:14 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-10-26 19:09:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 19:09:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 19:10:09 [DEBUG   ] Finished updating ant stats in 0.783 seconds
2018-10-26 19:10:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:10:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:10:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:10:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:10:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:10:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:10:14 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-26 19:10:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 19:10:37 [DEBUG   ] Got command RPT from MCS: ref #280032
2018-10-26 19:10:37 [DEBUG   ] summary = ERROR
2018-10-26 19:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280032  13 58417 69037485 A  ERRORERROR'
2018-10-26 19:10:37 [DEBUG   ] Got command RPT from MCS: ref #280033
2018-10-26 19:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280033  77 58417 69037486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:10:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 19:11:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 19:11:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:11:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:11:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:11:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:11:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:11:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:11:14 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-10-26 19:11:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 19:11:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 19:12:10 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-26 19:12:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 19:12:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:12:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:12:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:12:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:12:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:12:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:12:14 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-10-26 19:12:30 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-26 19:12:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:13:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 19:13:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:13:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:13:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:13:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:13:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:13:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:13:14 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-10-26 19:13:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 19:13:40 [DEBUG   ] Got command RPT from MCS: ref #280055
2018-10-26 19:13:40 [DEBUG   ] summary = ERROR
2018-10-26 19:13:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280055  13 58417 69220997 A  ERRORERROR'
2018-10-26 19:13:41 [DEBUG   ] Got command RPT from MCS: ref #280056
2018-10-26 19:13:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:13:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280056  77 58417 69221201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:13:41 [DEBUG   ] Got command RPT from MCS: ref #280057
2018-10-26 19:13:41 [DEBUG   ] summary = ERROR
2018-10-26 19:13:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280057  13 58417 69221405 A  ERRORERROR'
2018-10-26 19:13:41 [DEBUG   ] Got command RPT from MCS: ref #280059
2018-10-26 19:13:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:13:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280059  77 58417 69221597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:13:41 [DEBUG   ] Got command RPT from MCS: ref #280060
2018-10-26 19:13:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 19:13:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280060  12 58417 69221801 A  ERRORB˜™š'
2018-10-26 19:13:50 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 19:14:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 19:14:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:14:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:14:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:14:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:14:14 [WARNING ] (13, 1, 'bot')
2018-10-26 19:14:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:14:14 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-10-26 19:14:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 19:14:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 19:15:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 19:15:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:15:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:15:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:15:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:15:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:15:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:15:15 [DEBUG   ] Finished updating board flags in 2.052 seconds
2018-10-26 19:15:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 19:15:37 [DEBUG   ] Got command RPT from MCS: ref #280090
2018-10-26 19:15:37 [DEBUG   ] summary = ERROR
2018-10-26 19:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280090  13 58417 69337493 A  ERRORERROR'
2018-10-26 19:15:37 [DEBUG   ] Got command RPT from MCS: ref #280091
2018-10-26 19:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280091  77 58417 69337494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:15:51 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-26 19:16:11 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-26 19:16:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:16:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:16:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:16:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:16:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:16:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:16:15 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-10-26 19:16:31 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 19:16:36 [DEBUG   ] Got command TBN from MCS: ref #280130
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '1', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '2', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-26 19:16:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   280130   8 58417 69396421 A  ERROR'
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '3', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '4', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '5', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '6', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '7', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '8', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '9', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '10', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '11', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '12', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '13', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '14', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '15', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '16', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '17', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '18', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '19', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '20', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '21', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '22', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '23', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '24', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '25', '1540581397']
2018-10-26 19:16:36 [DEBUG   ] spawn_process: at 2018-10-26 19:16:36 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '10000000.0', '7', '22', '0', '26', '1540581397']
2018-10-26 19:16:36 [INFO    ] Finished spawning TBN in 0.054 s
2018-10-26 19:16:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 19:17:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 19:17:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:17:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:17:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:17:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:17:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:17:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:17:15 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-10-26 19:17:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 19:17:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 19:18:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 19:18:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:18:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:18:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:18:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:18:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:18:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:18:15 [DEBUG   ] Finished updating board flags in 1.918 seconds
2018-10-26 19:18:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 19:18:41 [DEBUG   ] Got command RPT from MCS: ref #280141
2018-10-26 19:18:41 [DEBUG   ] summary = ERROR
2018-10-26 19:18:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280141  13 58417 69521085 A  ERRORERROR'
2018-10-26 19:18:41 [DEBUG   ] Got command RPT from MCS: ref #280142
2018-10-26 19:18:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:18:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280142  77 58417 69521289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:18:41 [DEBUG   ] Got command RPT from MCS: ref #280143
2018-10-26 19:18:41 [DEBUG   ] summary = ERROR
2018-10-26 19:18:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280143  13 58417 69521493 A  ERRORERROR'
2018-10-26 19:18:41 [DEBUG   ] Got command RPT from MCS: ref #280144
2018-10-26 19:18:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:18:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280144  77 58417 69521691 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:18:41 [DEBUG   ] Got command RPT from MCS: ref #280145
2018-10-26 19:18:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 19:18:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280145  12 58417 69521893 A  ERRORB–™š'
2018-10-26 19:18:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 19:19:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 19:19:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:19:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:19:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:19:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:19:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:19:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:19:15 [DEBUG   ] Finished updating board flags in 1.708 seconds
2018-10-26 19:19:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 19:19:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 19:20:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 19:20:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:20:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:20:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:20:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:20:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:20:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:20:15 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-26 19:20:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 19:20:37 [DEBUG   ] Got command RPT from MCS: ref #280153
2018-10-26 19:20:37 [DEBUG   ] summary = ERROR
2018-10-26 19:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280153  13 58417 69637485 A  ERRORERROR'
2018-10-26 19:20:37 [DEBUG   ] Got command RPT from MCS: ref #280154
2018-10-26 19:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280154  77 58417 69637486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:20:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 19:21:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 19:21:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:21:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:21:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:21:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:21:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:21:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:21:15 [DEBUG   ] Finished updating board flags in 1.561 seconds
2018-10-26 19:21:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 19:21:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 19:22:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 19:22:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:22:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 19:22:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:22:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:22:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:22:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:22:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:22:15 [DEBUG   ] Finished updating board flags in 1.435 seconds
2018-10-26 19:22:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 19:22:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 19:23:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 19:23:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 19:23:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:23:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:23:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:23:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:23:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:23:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:23:15 [DEBUG   ] Finished updating board flags in 1.559 seconds
2018-10-26 19:23:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 19:23:41 [DEBUG   ] Got command RPT from MCS: ref #280199
2018-10-26 19:23:41 [DEBUG   ] summary = ERROR
2018-10-26 19:23:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280199  13 58417 69821165 A  ERRORERROR'
2018-10-26 19:23:41 [DEBUG   ] Got command RPT from MCS: ref #280200
2018-10-26 19:23:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:23:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280200  77 58417 69821369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:23:41 [DEBUG   ] Got command RPT from MCS: ref #280201
2018-10-26 19:23:41 [DEBUG   ] summary = ERROR
2018-10-26 19:23:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280201  13 58417 69821573 A  ERRORERROR'
2018-10-26 19:23:41 [DEBUG   ] Got command RPT from MCS: ref #280203
2018-10-26 19:23:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:23:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280203  77 58417 69821777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:23:41 [DEBUG   ] Got command RPT from MCS: ref #280204
2018-10-26 19:23:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 19:23:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280204  12 58417 69821969 A  ERRORB—™š'
2018-10-26 19:23:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 19:24:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 19:24:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:24:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:24:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:24:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:24:15 [WARNING ] (13, 1, 'bot')
2018-10-26 19:24:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:24:15 [DEBUG   ] Finished updating board flags in 1.567 seconds
2018-10-26 19:24:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 19:24:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 19:25:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 19:25:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:25:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:25:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:25:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:25:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:25:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:25:16 [DEBUG   ] Finished updating board flags in 2.172 seconds
2018-10-26 19:25:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 19:25:37 [DEBUG   ] Got command RPT from MCS: ref #280238
2018-10-26 19:25:37 [DEBUG   ] summary = ERROR
2018-10-26 19:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280238  13 58417 69937489 A  ERRORERROR'
2018-10-26 19:25:37 [DEBUG   ] Got command RPT from MCS: ref #280239
2018-10-26 19:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280239  77 58417 69937490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:25:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 19:26:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 19:26:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:26:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 19:26:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:26:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:26:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:26:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:26:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:26:16 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-10-26 19:26:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:26:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 19:27:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 19:27:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 19:27:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:27:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:27:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:27:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:27:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:27:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:27:16 [DEBUG   ] Finished updating board flags in 1.698 seconds
2018-10-26 19:27:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 19:27:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 19:28:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 19:28:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:28:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 19:28:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:28:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:28:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:28:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:28:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:28:16 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-10-26 19:28:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 19:28:41 [DEBUG   ] Got command RPT from MCS: ref #280259
2018-10-26 19:28:41 [DEBUG   ] summary = ERROR
2018-10-26 19:28:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280259  13 58417 70121253 A  ERRORERROR'
2018-10-26 19:28:41 [DEBUG   ] Got command RPT from MCS: ref #280260
2018-10-26 19:28:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:28:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280260  77 58417 70121457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:28:41 [DEBUG   ] Got command RPT from MCS: ref #280261
2018-10-26 19:28:41 [DEBUG   ] summary = ERROR
2018-10-26 19:28:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280261  13 58417 70121661 A  ERRORERROR'
2018-10-26 19:28:41 [DEBUG   ] Got command RPT from MCS: ref #280262
2018-10-26 19:28:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:28:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280262  77 58417 70121865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:28:42 [DEBUG   ] Got command RPT from MCS: ref #280263
2018-10-26 19:28:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 19:28:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280263  12 58417 70122057 A  ERRORB˜™š'
2018-10-26 19:28:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 19:28:59 [DEBUG   ] Got command TBN from MCS: ref #280268
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-26 19:28:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   280268   8 58417 70139858 A  ERROR'
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540582141']
2018-10-26 19:28:59 [DEBUG   ] spawn_process: at 2018-10-26 19:28:59 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540582141']
2018-10-26 19:28:59 [INFO    ] Finished spawning TBN in 0.051 s
2018-10-26 19:29:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 19:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 19:29:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:29:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:29:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:29:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:29:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:29:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:29:16 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-10-26 19:29:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 19:29:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 19:30:11 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-26 19:30:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:30:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:30:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:30:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:30:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:30:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:30:16 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-26 19:30:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 19:30:37 [DEBUG   ] Got command RPT from MCS: ref #280269
2018-10-26 19:30:37 [DEBUG   ] summary = ERROR
2018-10-26 19:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280269  13 58417 70237497 A  ERRORERROR'
2018-10-26 19:30:37 [DEBUG   ] Got command RPT from MCS: ref #280270
2018-10-26 19:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280270  77 58417 70237498 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:30:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 19:31:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 19:31:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:31:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:31:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:31:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:31:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:31:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:31:16 [DEBUG   ] Finished updating board flags in 1.379 seconds
2018-10-26 19:31:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 19:31:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 19:32:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 19:32:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:32:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:32:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:32:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:32:16 [WARNING ] (13, 1, 'bot')
2018-10-26 19:32:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:32:16 [DEBUG   ] Finished updating board flags in 1.536 seconds
2018-10-26 19:32:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 19:32:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 19:33:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 19:33:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:33:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:33:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:33:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:33:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:33:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:33:17 [DEBUG   ] Finished updating board flags in 2.184 seconds
2018-10-26 19:33:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 19:33:41 [DEBUG   ] Got command RPT from MCS: ref #280292
2018-10-26 19:33:41 [DEBUG   ] summary = ERROR
2018-10-26 19:33:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280292  13 58417 70421349 A  ERRORERROR'
2018-10-26 19:33:41 [DEBUG   ] Got command RPT from MCS: ref #280293
2018-10-26 19:33:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:33:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280293  77 58417 70421541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:33:41 [DEBUG   ] Got command RPT from MCS: ref #280294
2018-10-26 19:33:41 [DEBUG   ] summary = ERROR
2018-10-26 19:33:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280294  13 58417 70421745 A  ERRORERROR'
2018-10-26 19:33:41 [DEBUG   ] Got command RPT from MCS: ref #280296
2018-10-26 19:33:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:33:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280296  77 58417 70421949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:33:42 [DEBUG   ] Got command RPT from MCS: ref #280297
2018-10-26 19:33:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 19:33:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280297  12 58417 70422141 A  ERRORB™™š'
2018-10-26 19:33:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 19:34:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 19:34:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 19:34:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 19:34:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:34:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:34:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:34:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:34:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:34:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:34:17 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-10-26 19:34:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 19:34:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 19:35:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 19:35:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:35:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 19:35:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:35:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:35:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:35:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:35:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:35:17 [DEBUG   ] Finished updating board flags in 1.880 seconds
2018-10-26 19:35:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 19:35:37 [DEBUG   ] Got command RPT from MCS: ref #280306
2018-10-26 19:35:37 [DEBUG   ] summary = ERROR
2018-10-26 19:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280306  13 58417 70537493 A  ERRORERROR'
2018-10-26 19:35:37 [DEBUG   ] Got command RPT from MCS: ref #280307
2018-10-26 19:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280307  77 58417 70537494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:35:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 19:36:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 19:36:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:36:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 19:36:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:36:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:36:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:36:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:36:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:36:17 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-26 19:36:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 19:36:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 19:37:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 19:37:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:37:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 19:37:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:37:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:37:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:37:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:37:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:37:17 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-10-26 19:37:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 19:37:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 19:38:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 19:38:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:38:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:38:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:38:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:38:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:38:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:38:17 [DEBUG   ] Finished updating board flags in 1.639 seconds
2018-10-26 19:38:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 19:38:41 [DEBUG   ] Got command RPT from MCS: ref #280327
2018-10-26 19:38:41 [DEBUG   ] summary = ERROR
2018-10-26 19:38:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280327  13 58417 70721429 A  ERRORERROR'
2018-10-26 19:38:41 [DEBUG   ] Got command RPT from MCS: ref #280328
2018-10-26 19:38:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:38:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280328  77 58417 70721633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:38:41 [DEBUG   ] Got command RPT from MCS: ref #280329
2018-10-26 19:38:41 [DEBUG   ] summary = ERROR
2018-10-26 19:38:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280329  13 58417 70721825 A  ERRORERROR'
2018-10-26 19:38:42 [DEBUG   ] Got command RPT from MCS: ref #280330
2018-10-26 19:38:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:38:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280330  77 58417 70722029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:38:42 [DEBUG   ] Got command RPT from MCS: ref #280331
2018-10-26 19:38:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 19:38:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280331  12 58417 70722233 A  ERRORB™™š'
2018-10-26 19:38:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 19:39:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 19:39:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:39:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:39:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:39:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:39:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:39:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:39:17 [DEBUG   ] Finished updating board flags in 1.651 seconds
2018-10-26 19:39:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 19:39:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 19:40:11 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-10-26 19:40:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 19:40:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:40:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:40:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:40:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:40:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:40:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:40:17 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-26 19:40:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 19:40:37 [DEBUG   ] Got command RPT from MCS: ref #280332
2018-10-26 19:40:37 [DEBUG   ] summary = ERROR
2018-10-26 19:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280332  13 58417 70837493 A  ERRORERROR'
2018-10-26 19:40:37 [DEBUG   ] Got command RPT from MCS: ref #280333
2018-10-26 19:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280333  77 58417 70837494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:40:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 19:41:12 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 19:41:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:41:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 19:41:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:41:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:41:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:41:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:41:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:41:17 [DEBUG   ] Finished updating board flags in 1.506 seconds
2018-10-26 19:41:32 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 19:41:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 19:42:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 19:42:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:42:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:42:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:42:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:42:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:42:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:42:17 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-10-26 19:42:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 19:42:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 19:43:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 19:43:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:43:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 19:43:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:43:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:43:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:43:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:43:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:43:17 [DEBUG   ] Finished updating board flags in 1.513 seconds
2018-10-26 19:43:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 19:43:41 [DEBUG   ] Got command RPT from MCS: ref #280355
2018-10-26 19:43:41 [DEBUG   ] summary = ERROR
2018-10-26 19:43:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280355  13 58417 71021521 A  ERRORERROR'
2018-10-26 19:43:41 [DEBUG   ] Got command RPT from MCS: ref #280356
2018-10-26 19:43:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:43:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280356  77 58417 71021713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:43:41 [DEBUG   ] Got command RPT from MCS: ref #280357
2018-10-26 19:43:41 [DEBUG   ] summary = ERROR
2018-10-26 19:43:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280357  13 58417 71021917 A  ERRORERROR'
2018-10-26 19:43:42 [DEBUG   ] Got command RPT from MCS: ref #280359
2018-10-26 19:43:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:43:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280359  77 58417 71022121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:43:42 [DEBUG   ] Got command RPT from MCS: ref #280360
2018-10-26 19:43:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 19:43:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280360  12 58417 71022313 A  ERRORB™™š'
2018-10-26 19:43:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 19:44:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:44:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:44:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:44:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:44:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:44:17 [WARNING ] (13, 1, 'bot')
2018-10-26 19:44:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:44:17 [DEBUG   ] Finished updating board flags in 1.520 seconds
2018-10-26 19:44:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:44:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 19:45:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:45:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:45:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 19:45:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:45:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:45:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:45:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:45:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:45:18 [DEBUG   ] Finished updating board flags in 2.163 seconds
2018-10-26 19:45:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:45:37 [DEBUG   ] Got command RPT from MCS: ref #280369
2018-10-26 19:45:37 [DEBUG   ] summary = ERROR
2018-10-26 19:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280369  13 58417 71137493 A  ERRORERROR'
2018-10-26 19:45:37 [DEBUG   ] Got command RPT from MCS: ref #280370
2018-10-26 19:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280370  77 58417 71137494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:45:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:46:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 19:46:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:46:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:46:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:46:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:46:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:46:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:46:18 [DEBUG   ] Finished updating board flags in 1.956 seconds
2018-10-26 19:46:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 19:46:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:47:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:47:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:47:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:47:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:47:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:47:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:47:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:47:18 [DEBUG   ] Finished updating board flags in 1.862 seconds
2018-10-26 19:47:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 19:47:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 19:48:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:48:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 19:48:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:48:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:48:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:48:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:48:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:48:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:48:18 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-10-26 19:48:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:48:41 [DEBUG   ] Got command RPT from MCS: ref #280390
2018-10-26 19:48:41 [DEBUG   ] summary = ERROR
2018-10-26 19:48:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280390  13 58417 71321605 A  ERRORERROR'
2018-10-26 19:48:41 [DEBUG   ] Got command RPT from MCS: ref #280391
2018-10-26 19:48:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:48:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280391  77 58417 71321797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:48:42 [DEBUG   ] Got command RPT from MCS: ref #280392
2018-10-26 19:48:42 [DEBUG   ] summary = ERROR
2018-10-26 19:48:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280392  13 58417 71322001 A  ERRORERROR'
2018-10-26 19:48:42 [DEBUG   ] Got command RPT from MCS: ref #280393
2018-10-26 19:48:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:48:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280393  77 58417 71322205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:48:42 [DEBUG   ] Got command RPT from MCS: ref #280394
2018-10-26 19:48:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 19:48:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280394  12 58417 71322409 A  ERRORB™™š'
2018-10-26 19:48:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 19:49:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 19:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 19:49:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:49:18 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 19:49:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:49:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:49:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:49:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:49:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:49:18 [DEBUG   ] Finished updating board flags in 1.710 seconds
2018-10-26 19:49:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:49:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:50:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 19:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 19:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 19:50:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:50:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:50:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:50:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:50:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:50:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:50:18 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-10-26 19:50:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:50:37 [DEBUG   ] Got command RPT from MCS: ref #280399
2018-10-26 19:50:37 [DEBUG   ] summary = ERROR
2018-10-26 19:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280399  13 58417 71437501 A  ERRORERROR'
2018-10-26 19:50:37 [DEBUG   ] Got command RPT from MCS: ref #280400
2018-10-26 19:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280400  77 58417 71437502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:50:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:51:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 19:51:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-26 19:51:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:51:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:51:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:51:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:51:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:51:18 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-26 19:51:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 19:51:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:52:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:52:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 19:52:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:52:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 19:52:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:52:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:52:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:52:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:52:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:52:18 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-10-26 19:52:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 19:52:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 19:53:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 19:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 19:53:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:53:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:53:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:53:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:53:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:53:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:53:18 [DEBUG   ] Finished updating board flags in 1.547 seconds
2018-10-26 19:53:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 19:53:41 [DEBUG   ] Got command RPT from MCS: ref #280422
2018-10-26 19:53:41 [DEBUG   ] summary = ERROR
2018-10-26 19:53:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280422  13 58417 71621686 A  ERRORERROR'
2018-10-26 19:53:41 [DEBUG   ] Got command RPT from MCS: ref #280423
2018-10-26 19:53:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:53:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280423  77 58417 71621889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:53:42 [DEBUG   ] Got command RPT from MCS: ref #280424
2018-10-26 19:53:42 [DEBUG   ] summary = ERROR
2018-10-26 19:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280424  13 58417 71622107 A  ERRORERROR'
2018-10-26 19:53:42 [DEBUG   ] Got command RPT from MCS: ref #280426
2018-10-26 19:53:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280426  77 58417 71622285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:53:42 [DEBUG   ] Got command RPT from MCS: ref #280427
2018-10-26 19:53:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 19:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280427  12 58417 71622489 A  ERRORB™™š'
2018-10-26 19:53:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 19:54:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 19:54:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 19:54:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:54:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:54:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:54:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:54:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:54:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:54:18 [DEBUG   ] Finished updating board flags in 1.546 seconds
2018-10-26 19:54:32 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 19:54:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 19:55:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 19:55:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 19:55:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:55:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:55:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:55:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:55:18 [WARNING ] (13, 1, 'bot')
2018-10-26 19:55:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:55:18 [DEBUG   ] Finished updating board flags in 1.546 seconds
2018-10-26 19:55:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 19:55:37 [DEBUG   ] Got command RPT from MCS: ref #280432
2018-10-26 19:55:37 [DEBUG   ] summary = ERROR
2018-10-26 19:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280432  13 58417 71737493 A  ERRORERROR'
2018-10-26 19:55:37 [DEBUG   ] Got command RPT from MCS: ref #280433
2018-10-26 19:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280433  77 58417 71737494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:55:52 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 19:56:13 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-26 19:56:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:56:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 19:56:19 [WARNING ] (13, 1, 'bot')
2018-10-26 19:56:19 [WARNING ] (13, 1, 'bot')
2018-10-26 19:56:19 [WARNING ] (13, 1, 'bot')
2018-10-26 19:56:19 [WARNING ] (13, 1, 'bot')
2018-10-26 19:56:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:56:19 [DEBUG   ] Finished updating board flags in 2.182 seconds
2018-10-26 19:56:33 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 19:56:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 19:57:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 19:57:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:57:19 [WARNING ] (13, 1, 'bot')
2018-10-26 19:57:19 [WARNING ] (13, 1, 'bot')
2018-10-26 19:57:19 [WARNING ] (13, 1, 'bot')
2018-10-26 19:57:19 [WARNING ] (13, 1, 'bot')
2018-10-26 19:57:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:57:19 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-10-26 19:57:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 19:57:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 19:58:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 19:58:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:58:19 [WARNING ] (13, 1, 'bot')
2018-10-26 19:58:19 [WARNING ] (13, 1, 'bot')
2018-10-26 19:58:19 [WARNING ] (13, 1, 'bot')
2018-10-26 19:58:19 [WARNING ] (13, 1, 'bot')
2018-10-26 19:58:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:58:19 [DEBUG   ] Finished updating board flags in 1.937 seconds
2018-10-26 19:58:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 19:58:41 [DEBUG   ] Got command RPT from MCS: ref #280463
2018-10-26 19:58:41 [DEBUG   ] summary = ERROR
2018-10-26 19:58:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280463  13 58417 71921773 A  ERRORERROR'
2018-10-26 19:58:41 [DEBUG   ] Got command RPT from MCS: ref #280464
2018-10-26 19:58:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:58:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280464  77 58417 71921977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:58:42 [DEBUG   ] Got command RPT from MCS: ref #280465
2018-10-26 19:58:42 [DEBUG   ] summary = ERROR
2018-10-26 19:58:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280465  13 58417 71922169 A  ERRORERROR'
2018-10-26 19:58:42 [DEBUG   ] Got command RPT from MCS: ref #280466
2018-10-26 19:58:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 19:58:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280466  77 58417 71922373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 19:58:42 [DEBUG   ] Got command RPT from MCS: ref #280467
2018-10-26 19:58:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 19:58:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280467  12 58417 71922577 A  ERRORB™™š'
2018-10-26 19:58:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 19:59:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 19:59:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 19:59:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 19:59:19 [WARNING ] (13, 1, 'bot')
2018-10-26 19:59:19 [WARNING ] (13, 1, 'bot')
2018-10-26 19:59:19 [WARNING ] (13, 1, 'bot')
2018-10-26 19:59:19 [WARNING ] (13, 1, 'bot')
2018-10-26 19:59:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 19:59:19 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-10-26 19:59:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 19:59:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 20:00:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:00:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:00:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:00:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:00:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:00:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:00:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:00:19 [DEBUG   ] Finished updating board flags in 1.638 seconds
2018-10-26 20:00:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:00:37 [DEBUG   ] Got command RPT from MCS: ref #280472
2018-10-26 20:00:37 [DEBUG   ] summary = ERROR
2018-10-26 20:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280472  13 58417 72037497 A  ERRORERROR'
2018-10-26 20:00:37 [DEBUG   ] Got command RPT from MCS: ref #280473
2018-10-26 20:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280473  77 58417 72037498 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:00:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:01:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:01:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:01:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:01:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:01:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:01:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:01:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:01:19 [DEBUG   ] Finished updating board flags in 1.548 seconds
2018-10-26 20:01:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 20:01:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 20:02:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 20:02:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:02:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 20:02:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:02:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:02:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:02:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:02:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:02:19 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-10-26 20:02:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 20:02:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 20:03:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 20:03:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:03:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:03:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:03:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:03:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:03:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:03:19 [DEBUG   ] Finished updating board flags in 1.496 seconds
2018-10-26 20:03:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 20:03:41 [DEBUG   ] Got command RPT from MCS: ref #280495
2018-10-26 20:03:41 [DEBUG   ] summary = ERROR
2018-10-26 20:03:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280495  13 58417 72221857 A  ERRORERROR'
2018-10-26 20:03:42 [DEBUG   ] Got command RPT from MCS: ref #280496
2018-10-26 20:03:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:03:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280496  77 58417 72222061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:03:42 [DEBUG   ] Got command RPT from MCS: ref #280497
2018-10-26 20:03:42 [DEBUG   ] summary = ERROR
2018-10-26 20:03:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280497  13 58417 72222265 A  ERRORERROR'
2018-10-26 20:03:42 [DEBUG   ] Got command RPT from MCS: ref #280499
2018-10-26 20:03:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:03:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280499  77 58417 72222457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:03:42 [DEBUG   ] Got command RPT from MCS: ref #280500
2018-10-26 20:03:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 20:03:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280500  12 58417 72222661 A  ERRORB™™š'
2018-10-26 20:03:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 20:04:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 20:04:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:04:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 20:04:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:04:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:04:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:04:19 [WARNING ] (13, 1, 'bot')
2018-10-26 20:04:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:04:19 [DEBUG   ] Finished updating board flags in 1.557 seconds
2018-10-26 20:04:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 20:04:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 20:05:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 20:05:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:05:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:05:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:05:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:05:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:05:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:05:20 [DEBUG   ] Finished updating board flags in 2.223 seconds
2018-10-26 20:05:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 20:05:37 [DEBUG   ] Got command RPT from MCS: ref #280509
2018-10-26 20:05:37 [DEBUG   ] summary = ERROR
2018-10-26 20:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280509  13 58417 72337501 A  ERRORERROR'
2018-10-26 20:05:37 [DEBUG   ] Got command RPT from MCS: ref #280510
2018-10-26 20:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280510  77 58417 72337502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:05:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 20:06:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 20:06:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:06:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:06:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:06:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:06:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:06:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:06:20 [DEBUG   ] Finished updating board flags in 2.236 seconds
2018-10-26 20:06:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 20:06:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 20:07:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 20:07:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:07:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:07:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:07:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:07:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:07:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:07:20 [DEBUG   ] Finished updating board flags in 2.085 seconds
2018-10-26 20:07:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 20:07:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 20:08:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 20:08:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 20:08:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:08:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 20:08:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:08:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:08:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:08:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:08:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:08:20 [DEBUG   ] Finished updating board flags in 2.021 seconds
2018-10-26 20:08:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 20:08:41 [DEBUG   ] Got command RPT from MCS: ref #280530
2018-10-26 20:08:41 [DEBUG   ] summary = ERROR
2018-10-26 20:08:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280530  13 58417 72521941 A  ERRORERROR'
2018-10-26 20:08:42 [DEBUG   ] Got command RPT from MCS: ref #280531
2018-10-26 20:08:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:08:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280531  77 58417 72522145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:08:42 [DEBUG   ] Got command RPT from MCS: ref #280532
2018-10-26 20:08:42 [DEBUG   ] summary = ERROR
2018-10-26 20:08:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280532  13 58417 72522349 A  ERRORERROR'
2018-10-26 20:08:42 [DEBUG   ] Got command RPT from MCS: ref #280533
2018-10-26 20:08:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:08:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280533  77 58417 72522553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:08:42 [DEBUG   ] Got command RPT from MCS: ref #280534
2018-10-26 20:08:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 20:08:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280534  12 58417 72522746 A  ERRORB™™š'
2018-10-26 20:08:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 20:09:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 20:09:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:09:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:09:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:09:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:09:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:09:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:09:20 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-10-26 20:09:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 20:09:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 20:10:13 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-10-26 20:10:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:10:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 20:10:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:10:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:10:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:10:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:10:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:10:20 [DEBUG   ] Finished updating board flags in 1.830 seconds
2018-10-26 20:10:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 20:10:37 [DEBUG   ] Got command RPT from MCS: ref #280535
2018-10-26 20:10:37 [DEBUG   ] summary = ERROR
2018-10-26 20:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280535  13 58417 72637501 A  ERRORERROR'
2018-10-26 20:10:37 [DEBUG   ] Got command RPT from MCS: ref #280536
2018-10-26 20:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280536  77 58417 72637502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:10:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:11:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 20:11:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:11:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 20:11:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:11:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:11:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:11:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:11:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:11:20 [DEBUG   ] Finished updating board flags in 1.769 seconds
2018-10-26 20:11:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 20:11:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:12:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:12:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 20:12:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:12:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:12:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:12:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:12:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:12:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:12:20 [DEBUG   ] Finished updating board flags in 1.693 seconds
2018-10-26 20:12:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 20:12:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 20:13:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:13:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:13:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:13:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:13:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:13:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:13:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:13:20 [DEBUG   ] Finished updating board flags in 1.510 seconds
2018-10-26 20:13:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 20:13:42 [DEBUG   ] Got command RPT from MCS: ref #280558
2018-10-26 20:13:42 [DEBUG   ] summary = ERROR
2018-10-26 20:13:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280558  13 58417 72822025 A  ERRORERROR'
2018-10-26 20:13:42 [DEBUG   ] Got command RPT from MCS: ref #280559
2018-10-26 20:13:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:13:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280559  77 58417 72822229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:13:42 [DEBUG   ] Got command RPT from MCS: ref #280560
2018-10-26 20:13:42 [DEBUG   ] summary = ERROR
2018-10-26 20:13:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280560  13 58417 72822433 A  ERRORERROR'
2018-10-26 20:13:42 [DEBUG   ] Got command RPT from MCS: ref #280562
2018-10-26 20:13:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:13:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280562  77 58417 72822637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:13:42 [DEBUG   ] Got command RPT from MCS: ref #280564
2018-10-26 20:13:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 20:13:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280564  12 58417 72822829 A  ERRORB™™š'
2018-10-26 20:13:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 20:14:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 20:14:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:14:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:14:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:14:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:14:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:14:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:14:20 [DEBUG   ] Finished updating board flags in 1.440 seconds
2018-10-26 20:14:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 20:14:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:15:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 20:15:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:15:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:15:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:15:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:15:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:15:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:15:20 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-10-26 20:15:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 20:15:37 [DEBUG   ] Got command RPT from MCS: ref #280572
2018-10-26 20:15:37 [DEBUG   ] summary = ERROR
2018-10-26 20:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280572  13 58417 72937505 A  ERRORERROR'
2018-10-26 20:15:37 [DEBUG   ] Got command RPT from MCS: ref #280573
2018-10-26 20:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280573  77 58417 72937506 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:15:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:16:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:16:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:16:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 20:16:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:16:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:16:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:16:20 [WARNING ] (13, 1, 'bot')
2018-10-26 20:16:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:16:20 [DEBUG   ] Finished updating board flags in 1.518 seconds
2018-10-26 20:16:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 20:16:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 20:17:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:17:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:17:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 20:17:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:17:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:17:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:17:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:17:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:17:21 [DEBUG   ] Finished updating board flags in 2.236 seconds
2018-10-26 20:17:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:17:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 20:18:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:18:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:18:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:18:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:18:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:18:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:18:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:18:21 [DEBUG   ] Finished updating board flags in 2.233 seconds
2018-10-26 20:18:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:18:42 [DEBUG   ] Got command RPT from MCS: ref #280593
2018-10-26 20:18:42 [DEBUG   ] summary = ERROR
2018-10-26 20:18:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280593  13 58417 73122113 A  ERRORERROR'
2018-10-26 20:18:42 [DEBUG   ] Got command RPT from MCS: ref #280594
2018-10-26 20:18:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:18:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280594  77 58417 73122317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:18:42 [DEBUG   ] Got command RPT from MCS: ref #280595
2018-10-26 20:18:42 [DEBUG   ] summary = ERROR
2018-10-26 20:18:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280595  13 58417 73122521 A  ERRORERROR'
2018-10-26 20:18:42 [DEBUG   ] Got command RPT from MCS: ref #280596
2018-10-26 20:18:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:18:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280596  77 58417 73122713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:18:42 [DEBUG   ] Got command RPT from MCS: ref #280597
2018-10-26 20:18:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 20:18:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280597  12 58417 73122917 A  ERRORBš™š'
2018-10-26 20:18:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 20:19:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 20:19:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:19:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 20:19:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:19:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:19:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:19:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:19:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:19:21 [DEBUG   ] Finished updating board flags in 2.104 seconds
2018-10-26 20:19:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 20:19:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:20:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 20:20:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:20:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:20:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:20:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:20:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:20:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:20:21 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-10-26 20:20:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 20:20:37 [DEBUG   ] Got command RPT from MCS: ref #280602
2018-10-26 20:20:37 [DEBUG   ] summary = ERROR
2018-10-26 20:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280602  13 58417 73237497 A  ERRORERROR'
2018-10-26 20:20:37 [DEBUG   ] Got command RPT from MCS: ref #280603
2018-10-26 20:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280603  77 58417 73237498 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:20:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 20:21:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:21:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 20:21:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:21:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:21:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:21:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:21:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:21:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:21:21 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-10-26 20:21:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:21:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 20:22:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 20:22:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:22:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:22:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:22:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:22:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:22:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:22:21 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-10-26 20:22:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:22:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 20:23:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 20:23:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:23:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:23:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:23:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:23:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:23:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:23:21 [DEBUG   ] Finished updating board flags in 1.661 seconds
2018-10-26 20:23:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 20:23:42 [DEBUG   ] Got command RPT from MCS: ref #280625
2018-10-26 20:23:42 [DEBUG   ] summary = ERROR
2018-10-26 20:23:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280625  13 58417 73422205 A  ERRORERROR'
2018-10-26 20:23:42 [DEBUG   ] Got command RPT from MCS: ref #280626
2018-10-26 20:23:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:23:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280626  77 58417 73422397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:23:42 [DEBUG   ] Got command RPT from MCS: ref #280627
2018-10-26 20:23:42 [DEBUG   ] summary = ERROR
2018-10-26 20:23:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280627  13 58417 73422601 A  ERRORERROR'
2018-10-26 20:23:42 [DEBUG   ] Got command RPT from MCS: ref #280629
2018-10-26 20:23:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:23:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280629  77 58417 73422805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:23:43 [DEBUG   ] Got command RPT from MCS: ref #280631
2018-10-26 20:23:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 20:23:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280631  12 58417 73423009 A  ERRORBš™š'
2018-10-26 20:23:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:24:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:24:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:24:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:24:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:24:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:24:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:24:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:24:21 [DEBUG   ] Finished updating board flags in 1.634 seconds
2018-10-26 20:24:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 20:24:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 20:25:13 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-26 20:25:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:25:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:25:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:25:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:25:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:25:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:25:21 [DEBUG   ] Finished updating board flags in 1.490 seconds
2018-10-26 20:25:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 20:25:37 [DEBUG   ] Got command RPT from MCS: ref #280635
2018-10-26 20:25:37 [DEBUG   ] summary = ERROR
2018-10-26 20:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280635  13 58417 73537501 A  ERRORERROR'
2018-10-26 20:25:37 [DEBUG   ] Got command RPT from MCS: ref #280636
2018-10-26 20:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280636  77 58417 73537502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:25:53 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-26 20:26:13 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-26 20:26:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:26:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:26:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:26:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:26:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:26:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:26:21 [DEBUG   ] Finished updating board flags in 1.479 seconds
2018-10-26 20:26:34 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 20:26:54 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 20:27:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 20:27:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:27:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:27:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:27:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:27:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:27:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:27:21 [DEBUG   ] Finished updating board flags in 1.478 seconds
2018-10-26 20:27:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:27:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:28:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:28:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:28:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:28:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:28:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:28:21 [WARNING ] (13, 1, 'bot')
2018-10-26 20:28:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:28:21 [DEBUG   ] Finished updating board flags in 1.496 seconds
2018-10-26 20:28:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-26 20:28:42 [DEBUG   ] Got command RPT from MCS: ref #280656
2018-10-26 20:28:42 [DEBUG   ] summary = ERROR
2018-10-26 20:28:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280656  13 58417 73722289 A  ERRORERROR'
2018-10-26 20:28:42 [DEBUG   ] Got command RPT from MCS: ref #280657
2018-10-26 20:28:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:28:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280657  77 58417 73722493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:28:42 [DEBUG   ] Got command RPT from MCS: ref #280658
2018-10-26 20:28:42 [DEBUG   ] summary = ERROR
2018-10-26 20:28:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280658  13 58417 73722685 A  ERRORERROR'
2018-10-26 20:28:42 [DEBUG   ] Got command RPT from MCS: ref #280659
2018-10-26 20:28:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:28:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280659  77 58417 73722889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:28:43 [DEBUG   ] Got command RPT from MCS: ref #280660
2018-10-26 20:28:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 20:28:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280660  12 58417 73723093 A  ERRORBš™š'
2018-10-26 20:28:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:29:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:29:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:29:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 20:29:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:29:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:29:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:29:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:29:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:29:22 [DEBUG   ] Finished updating board flags in 2.192 seconds
2018-10-26 20:29:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 20:29:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:30:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:30:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:30:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:30:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:30:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:30:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:30:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:30:22 [DEBUG   ] Finished updating board flags in 1.974 seconds
2018-10-26 20:30:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:30:37 [DEBUG   ] Got command RPT from MCS: ref #280665
2018-10-26 20:30:37 [DEBUG   ] summary = ERROR
2018-10-26 20:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280665  13 58417 73837501 A  ERRORERROR'
2018-10-26 20:30:37 [DEBUG   ] Got command RPT from MCS: ref #280666
2018-10-26 20:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280666  77 58417 73837502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:30:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:31:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:31:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:31:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-26 20:31:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:31:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:31:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:31:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:31:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:31:22 [DEBUG   ] Finished updating board flags in 1.908 seconds
2018-10-26 20:31:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:31:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 20:32:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 20:32:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:32:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 20:32:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:32:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:32:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:32:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:32:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:32:22 [DEBUG   ] Finished updating board flags in 1.689 seconds
2018-10-26 20:32:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 20:32:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 20:33:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 20:33:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:33:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 20:33:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 20:33:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:33:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:33:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:33:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:33:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:33:22 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-26 20:33:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 20:33:42 [DEBUG   ] Got command RPT from MCS: ref #280688
2018-10-26 20:33:42 [DEBUG   ] summary = ERROR
2018-10-26 20:33:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280688  13 58417 74022369 A  ERRORERROR'
2018-10-26 20:33:42 [DEBUG   ] Got command RPT from MCS: ref #280689
2018-10-26 20:33:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:33:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280689  77 58417 74022573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:33:42 [DEBUG   ] Got command RPT from MCS: ref #280690
2018-10-26 20:33:42 [DEBUG   ] summary = ERROR
2018-10-26 20:33:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280690  13 58417 74022777 A  ERRORERROR'
2018-10-26 20:33:42 [DEBUG   ] Got command RPT from MCS: ref #280692
2018-10-26 20:33:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:33:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280692  77 58417 74022969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:33:43 [DEBUG   ] Got command RPT from MCS: ref #280693
2018-10-26 20:33:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 20:33:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280693  12 58417 74023173 A  ERRORBš™š'
2018-10-26 20:33:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 20:34:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 20:34:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 20:34:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:34:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:34:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:34:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:34:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:34:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:34:22 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-10-26 20:34:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 20:34:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 20:35:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 20:35:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:35:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:35:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:35:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:35:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:35:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:35:22 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-26 20:35:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 20:35:37 [DEBUG   ] Got command RPT from MCS: ref #280702
2018-10-26 20:35:37 [DEBUG   ] summary = ERROR
2018-10-26 20:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280702  13 58417 74137509 A  ERRORERROR'
2018-10-26 20:35:37 [DEBUG   ] Got command RPT from MCS: ref #280703
2018-10-26 20:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280703  77 58417 74137510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:35:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 20:36:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:36:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:36:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:36:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:36:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:36:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:36:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:36:22 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-10-26 20:36:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 20:36:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 20:37:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 20:37:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:37:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 20:37:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:37:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:37:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:37:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:37:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:37:22 [DEBUG   ] Finished updating board flags in 1.490 seconds
2018-10-26 20:37:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 20:37:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 20:38:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 20:38:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 20:38:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:38:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 20:38:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:38:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:38:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:38:22 [WARNING ] (13, 1, 'bot')
2018-10-26 20:38:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:38:22 [DEBUG   ] Finished updating board flags in 1.485 seconds
2018-10-26 20:38:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 20:38:42 [DEBUG   ] Got command RPT from MCS: ref #280723
2018-10-26 20:38:42 [DEBUG   ] summary = ERROR
2018-10-26 20:38:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280723  13 58417 74322453 A  ERRORERROR'
2018-10-26 20:38:42 [DEBUG   ] Got command RPT from MCS: ref #280724
2018-10-26 20:38:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:38:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280724  77 58417 74322657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:38:42 [DEBUG   ] Got command RPT from MCS: ref #280725
2018-10-26 20:38:42 [DEBUG   ] summary = ERROR
2018-10-26 20:38:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280725  13 58417 74322861 A  ERRORERROR'
2018-10-26 20:38:43 [DEBUG   ] Got command RPT from MCS: ref #280726
2018-10-26 20:38:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:38:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280726  77 58417 74323065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:38:43 [DEBUG   ] Got command RPT from MCS: ref #280727
2018-10-26 20:38:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 20:38:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280727  12 58417 74323257 A  ERRORBš™š'
2018-10-26 20:38:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 20:39:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 20:39:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:39:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:39:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:39:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:39:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:39:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:39:23 [DEBUG   ] Finished updating board flags in 2.272 seconds
2018-10-26 20:39:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 20:39:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 20:40:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 20:40:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:40:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-26 20:40:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 20:40:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:40:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:40:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:40:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:40:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:40:23 [DEBUG   ] Finished updating board flags in 2.113 seconds
2018-10-26 20:40:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 20:40:37 [DEBUG   ] Got command RPT from MCS: ref #280728
2018-10-26 20:40:37 [DEBUG   ] summary = ERROR
2018-10-26 20:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280728  13 58417 74437501 A  ERRORERROR'
2018-10-26 20:40:37 [DEBUG   ] Got command RPT from MCS: ref #280729
2018-10-26 20:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280729  77 58417 74437502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:40:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 20:41:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 20:41:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:41:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 20:41:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:41:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:41:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:41:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:41:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:41:23 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-10-26 20:41:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 20:41:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 20:42:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 20:42:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 20:42:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:42:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:42:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:42:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:42:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:42:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:42:23 [DEBUG   ] Finished updating board flags in 1.958 seconds
2018-10-26 20:42:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 20:42:55 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-26 20:43:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 20:43:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:43:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:43:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:43:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:43:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:43:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:43:23 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-10-26 20:43:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:43:42 [DEBUG   ] Got command RPT from MCS: ref #280751
2018-10-26 20:43:42 [DEBUG   ] summary = ERROR
2018-10-26 20:43:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280751  13 58417 74622545 A  ERRORERROR'
2018-10-26 20:43:42 [DEBUG   ] Got command RPT from MCS: ref #280752
2018-10-26 20:43:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:43:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280752  77 58417 74622749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:43:42 [DEBUG   ] Got command RPT from MCS: ref #280753
2018-10-26 20:43:42 [DEBUG   ] summary = ERROR
2018-10-26 20:43:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280753  13 58417 74622941 A  ERRORERROR'
2018-10-26 20:43:43 [DEBUG   ] Got command RPT from MCS: ref #280755
2018-10-26 20:43:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:43:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280755  77 58417 74623145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:43:43 [DEBUG   ] Got command RPT from MCS: ref #280756
2018-10-26 20:43:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 20:43:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280756  12 58417 74623349 A  ERRORBš™š'
2018-10-26 20:43:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 20:44:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:44:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:44:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 20:44:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:44:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:44:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:44:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:44:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:44:23 [DEBUG   ] Finished updating board flags in 1.774 seconds
2018-10-26 20:44:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:44:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:45:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 20:45:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:45:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:45:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:45:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:45:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:45:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:45:23 [DEBUG   ] Finished updating board flags in 1.626 seconds
2018-10-26 20:45:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:45:37 [DEBUG   ] Got command RPT from MCS: ref #280765
2018-10-26 20:45:37 [DEBUG   ] summary = ERROR
2018-10-26 20:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280765  13 58417 74737513 A  ERRORERROR'
2018-10-26 20:45:37 [DEBUG   ] Got command RPT from MCS: ref #280766
2018-10-26 20:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280766  77 58417 74737514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:45:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:46:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:46:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:46:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:46:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:46:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:46:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:46:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:46:23 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-26 20:46:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 20:46:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:47:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 20:47:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:47:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:47:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:47:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:47:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:47:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:47:23 [DEBUG   ] Finished updating board flags in 1.683 seconds
2018-10-26 20:47:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:47:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 20:48:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:48:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 20:48:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:48:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:48:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:48:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:48:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:48:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:48:23 [DEBUG   ] Finished updating board flags in 1.494 seconds
2018-10-26 20:48:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:48:42 [DEBUG   ] Got command RPT from MCS: ref #280786
2018-10-26 20:48:42 [DEBUG   ] summary = ERROR
2018-10-26 20:48:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280786  13 58417 74922629 A  ERRORERROR'
2018-10-26 20:48:42 [DEBUG   ] Got command RPT from MCS: ref #280787
2018-10-26 20:48:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:48:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280787  77 58417 74922833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:48:43 [DEBUG   ] Got command RPT from MCS: ref #280788
2018-10-26 20:48:43 [DEBUG   ] summary = ERROR
2018-10-26 20:48:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280788  13 58417 74923037 A  ERRORERROR'
2018-10-26 20:48:43 [DEBUG   ] Got command RPT from MCS: ref #280789
2018-10-26 20:48:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:48:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280789  77 58417 74923229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:48:43 [DEBUG   ] Got command RPT from MCS: ref #280790
2018-10-26 20:48:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 20:48:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280790  12 58417 74923433 A  ERRORBš™š'
2018-10-26 20:48:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:49:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 20:49:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 20:49:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:49:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:49:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:49:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:49:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:49:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:49:23 [DEBUG   ] Finished updating board flags in 1.500 seconds
2018-10-26 20:49:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:49:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 20:50:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:50:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:50:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:50:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:50:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:50:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:50:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:50:23 [DEBUG   ] Finished updating board flags in 1.508 seconds
2018-10-26 20:50:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 20:50:37 [DEBUG   ] Got command RPT from MCS: ref #280795
2018-10-26 20:50:37 [DEBUG   ] summary = ERROR
2018-10-26 20:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280795  13 58417 75037505 A  ERRORERROR'
2018-10-26 20:50:37 [DEBUG   ] Got command RPT from MCS: ref #280796
2018-10-26 20:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280796  77 58417 75037506 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:50:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:51:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:51:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:51:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:51:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:51:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:51:23 [WARNING ] (13, 1, 'bot')
2018-10-26 20:51:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:51:23 [DEBUG   ] Finished updating board flags in 1.533 seconds
2018-10-26 20:51:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:51:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 20:52:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:52:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 20:52:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:52:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 20:52:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:52:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:52:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:52:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:52:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:52:24 [DEBUG   ] Finished updating board flags in 2.130 seconds
2018-10-26 20:52:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:52:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:53:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 20:53:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:53:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:53:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:53:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:53:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:53:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:53:24 [DEBUG   ] Finished updating board flags in 2.037 seconds
2018-10-26 20:53:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 20:53:42 [DEBUG   ] Got command RPT from MCS: ref #280818
2018-10-26 20:53:42 [DEBUG   ] summary = ERROR
2018-10-26 20:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280818  13 58417 75222709 A  ERRORERROR'
2018-10-26 20:53:42 [DEBUG   ] Got command RPT from MCS: ref #280819
2018-10-26 20:53:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280819  77 58417 75222913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:53:43 [DEBUG   ] Got command RPT from MCS: ref #280820
2018-10-26 20:53:43 [DEBUG   ] summary = ERROR
2018-10-26 20:53:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280820  13 58417 75223117 A  ERRORERROR'
2018-10-26 20:53:43 [DEBUG   ] Got command RPT from MCS: ref #280822
2018-10-26 20:53:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:53:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280822  77 58417 75223321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:53:43 [DEBUG   ] Got command RPT from MCS: ref #280823
2018-10-26 20:53:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 20:53:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280823  12 58417 75223513 A  ERRORBš™š'
2018-10-26 20:53:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:54:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:54:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 20:54:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:54:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:54:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:54:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:54:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:54:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:54:24 [DEBUG   ] Finished updating board flags in 2.043 seconds
2018-10-26 20:54:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:54:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:55:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:55:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:55:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:55:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:55:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:55:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:55:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:55:24 [DEBUG   ] Finished updating board flags in 1.858 seconds
2018-10-26 20:55:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:55:37 [DEBUG   ] Got command RPT from MCS: ref #280828
2018-10-26 20:55:37 [DEBUG   ] summary = ERROR
2018-10-26 20:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280828  13 58417 75337509 A  ERRORERROR'
2018-10-26 20:55:37 [DEBUG   ] Got command RPT from MCS: ref #280829
2018-10-26 20:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280829  77 58417 75337510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:55:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 20:56:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:56:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:56:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:56:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:56:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:56:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:56:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:56:24 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-10-26 20:56:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 20:56:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:57:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 20:57:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:57:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:57:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:57:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:57:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:57:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:57:24 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-26 20:57:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 20:57:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 20:58:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 20:58:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:58:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:58:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:58:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:58:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:58:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:58:24 [DEBUG   ] Finished updating board flags in 1.766 seconds
2018-10-26 20:58:35 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 20:58:42 [DEBUG   ] Got command RPT from MCS: ref #280849
2018-10-26 20:58:42 [DEBUG   ] summary = ERROR
2018-10-26 20:58:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280849  13 58417 75522805 A  ERRORERROR'
2018-10-26 20:58:42 [DEBUG   ] Got command RPT from MCS: ref #280850
2018-10-26 20:58:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:58:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280850  77 58417 75522997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:58:43 [DEBUG   ] Got command RPT from MCS: ref #280851
2018-10-26 20:58:43 [DEBUG   ] summary = ERROR
2018-10-26 20:58:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280851  13 58417 75523201 A  ERRORERROR'
2018-10-26 20:58:43 [DEBUG   ] Got command RPT from MCS: ref #280852
2018-10-26 20:58:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 20:58:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280852  77 58417 75523405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 20:58:43 [DEBUG   ] Got command RPT from MCS: ref #280853
2018-10-26 20:58:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 20:58:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280853  12 58417 75523609 A  ERRORBš™š'
2018-10-26 20:58:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 20:59:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 20:59:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 20:59:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:59:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:59:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:59:24 [WARNING ] (13, 1, 'bot')
2018-10-26 20:59:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 20:59:24 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-10-26 20:59:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 20:59:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 21:00:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 21:00:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:00:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 21:00:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:00:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:00:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:00:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:00:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:00:24 [DEBUG   ] Finished updating board flags in 1.689 seconds
2018-10-26 21:00:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 21:00:37 [DEBUG   ] Got command RPT from MCS: ref #280858
2018-10-26 21:00:37 [DEBUG   ] summary = ERROR
2018-10-26 21:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280858  13 58417 75637513 A  ERRORERROR'
2018-10-26 21:00:37 [DEBUG   ] Got command RPT from MCS: ref #280859
2018-10-26 21:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280859  77 58417 75637514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:00:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 21:01:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 21:01:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:01:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 21:01:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:01:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:01:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:01:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:01:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:01:24 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-10-26 21:01:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 21:01:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 21:02:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 21:02:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:02:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 21:02:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:02:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:02:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:02:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:02:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:02:24 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-26 21:02:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 21:02:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 21:03:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 21:03:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:03:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 21:03:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:03:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:03:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:03:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:03:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:03:24 [DEBUG   ] Finished updating board flags in 1.501 seconds
2018-10-26 21:03:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 21:03:42 [DEBUG   ] Got command RPT from MCS: ref #280881
2018-10-26 21:03:42 [DEBUG   ] summary = ERROR
2018-10-26 21:03:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280881  13 58417 75822881 A  ERRORERROR'
2018-10-26 21:03:43 [DEBUG   ] Got command RPT from MCS: ref #280882
2018-10-26 21:03:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:03:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280882  77 58417 75823085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:03:43 [DEBUG   ] Got command RPT from MCS: ref #280883
2018-10-26 21:03:43 [DEBUG   ] summary = ERROR
2018-10-26 21:03:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280883  13 58417 75823289 A  ERRORERROR'
2018-10-26 21:03:43 [DEBUG   ] Got command RPT from MCS: ref #280885
2018-10-26 21:03:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:03:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280885  77 58417 75823493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:03:43 [DEBUG   ] Got command RPT from MCS: ref #280886
2018-10-26 21:03:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 21:03:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280886  12 58417 75823686 A  ERRORBš™š'
2018-10-26 21:03:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 21:04:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-26 21:04:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:04:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:04:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:04:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:04:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:04:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:04:24 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-26 21:04:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 21:04:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 21:05:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 21:05:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:05:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:05:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:05:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:05:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:05:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:05:24 [DEBUG   ] Finished updating board flags in 1.516 seconds
2018-10-26 21:05:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 21:05:37 [DEBUG   ] Got command RPT from MCS: ref #280895
2018-10-26 21:05:37 [DEBUG   ] summary = ERROR
2018-10-26 21:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280895  13 58417 75937509 A  ERRORERROR'
2018-10-26 21:05:37 [DEBUG   ] Got command RPT from MCS: ref #280896
2018-10-26 21:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280896  77 58417 75937510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:05:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 21:06:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 21:06:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:06:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:06:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:06:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:06:24 [WARNING ] (13, 1, 'bot')
2018-10-26 21:06:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:06:24 [DEBUG   ] Finished updating board flags in 1.533 seconds
2018-10-26 21:06:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 21:06:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 21:07:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 21:07:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:07:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 21:07:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 21:07:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:07:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:07:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:07:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:07:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:07:25 [DEBUG   ] Finished updating board flags in 2.280 seconds
2018-10-26 21:07:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 21:07:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 21:08:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 21:08:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:08:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:08:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:08:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:08:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:08:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:08:25 [DEBUG   ] Finished updating board flags in 2.091 seconds
2018-10-26 21:08:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 21:08:42 [DEBUG   ] Got command RPT from MCS: ref #280916
2018-10-26 21:08:42 [DEBUG   ] summary = ERROR
2018-10-26 21:08:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280916  13 58417 76122969 A  ERRORERROR'
2018-10-26 21:08:43 [DEBUG   ] Got command RPT from MCS: ref #280917
2018-10-26 21:08:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:08:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280917  77 58417 76123173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:08:43 [DEBUG   ] Got command RPT from MCS: ref #280918
2018-10-26 21:08:43 [DEBUG   ] summary = ERROR
2018-10-26 21:08:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280918  13 58417 76123377 A  ERRORERROR'
2018-10-26 21:08:43 [DEBUG   ] Got command RPT from MCS: ref #280919
2018-10-26 21:08:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:08:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280919  77 58417 76123569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:08:43 [DEBUG   ] Got command RPT from MCS: ref #280920
2018-10-26 21:08:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 21:08:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280920  12 58417 76123773 A  ERRORB›™š'
2018-10-26 21:08:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 21:09:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 21:09:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:09:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 21:09:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:09:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:09:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:09:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:09:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:09:25 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-10-26 21:09:36 [DEBUG   ] Finished updating ant stats in 1.350 seconds
2018-10-26 21:09:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 21:10:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 21:10:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:10:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:10:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:10:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:10:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:10:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:10:25 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-26 21:10:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 21:10:37 [DEBUG   ] Got command RPT from MCS: ref #280921
2018-10-26 21:10:37 [DEBUG   ] summary = ERROR
2018-10-26 21:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280921  13 58417 76237513 A  ERRORERROR'
2018-10-26 21:10:37 [DEBUG   ] Got command RPT from MCS: ref #280922
2018-10-26 21:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280922  77 58417 76237514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:10:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:11:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 21:11:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:11:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:11:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:11:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:11:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:11:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:11:25 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-10-26 21:11:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 21:11:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 21:12:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:12:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:12:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 21:12:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:12:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:12:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:12:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:12:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:12:25 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-10-26 21:12:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:12:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:13:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 21:13:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:13:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:13:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:13:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:13:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:13:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:13:25 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-10-26 21:13:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 21:13:43 [DEBUG   ] Got command RPT from MCS: ref #280944
2018-10-26 21:13:43 [DEBUG   ] summary = ERROR
2018-10-26 21:13:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280944  13 58417 76423053 A  ERRORERROR'
2018-10-26 21:13:43 [DEBUG   ] Got command RPT from MCS: ref #280945
2018-10-26 21:13:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:13:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280945  77 58417 76423257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:13:43 [DEBUG   ] Got command RPT from MCS: ref #280946
2018-10-26 21:13:43 [DEBUG   ] summary = ERROR
2018-10-26 21:13:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280946  13 58417 76423461 A  ERRORERROR'
2018-10-26 21:13:43 [DEBUG   ] Got command RPT from MCS: ref #280948
2018-10-26 21:13:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:13:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280948  77 58417 76423665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:13:43 [DEBUG   ] Got command RPT from MCS: ref #280949
2018-10-26 21:13:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 21:13:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280949  12 58417 76423857 A  ERRORBš™š'
2018-10-26 21:13:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 21:14:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 21:14:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:14:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 21:14:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 21:14:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:14:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:14:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:14:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:14:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:14:25 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-10-26 21:14:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 21:14:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 21:15:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 21:15:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:15:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 21:15:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:15:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:15:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:15:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:15:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:15:25 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-10-26 21:15:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 21:15:37 [DEBUG   ] Got command RPT from MCS: ref #280958
2018-10-26 21:15:37 [DEBUG   ] summary = ERROR
2018-10-26 21:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280958  13 58417 76537513 A  ERRORERROR'
2018-10-26 21:15:37 [DEBUG   ] Got command RPT from MCS: ref #280959
2018-10-26 21:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280959  77 58417 76537514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:15:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 21:16:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 21:16:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:16:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-26 21:16:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 21:16:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 21:16:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:16:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:16:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:16:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:16:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:16:25 [DEBUG   ] Finished updating board flags in 1.455 seconds
2018-10-26 21:16:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 21:16:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 21:17:16 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-26 21:17:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:17:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 21:17:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 21:17:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:17:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:17:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:17:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:17:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:17:25 [DEBUG   ] Finished updating board flags in 1.457 seconds
2018-10-26 21:17:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 21:17:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 21:18:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 21:18:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:18:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 21:18:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 21:18:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:18:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:18:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:18:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:18:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:18:25 [DEBUG   ] Finished updating board flags in 1.457 seconds
2018-10-26 21:18:36 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-26 21:18:43 [DEBUG   ] Got command RPT from MCS: ref #280979
2018-10-26 21:18:43 [DEBUG   ] summary = ERROR
2018-10-26 21:18:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280979  13 58417 76723145 A  ERRORERROR'
2018-10-26 21:18:43 [DEBUG   ] Got command RPT from MCS: ref #280980
2018-10-26 21:18:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:18:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280980  77 58417 76723349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:18:43 [DEBUG   ] Got command RPT from MCS: ref #280981
2018-10-26 21:18:43 [DEBUG   ] summary = ERROR
2018-10-26 21:18:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280981  13 58417 76723541 A  ERRORERROR'
2018-10-26 21:18:43 [DEBUG   ] Got command RPT from MCS: ref #280982
2018-10-26 21:18:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:18:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280982  77 58417 76723745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:18:43 [DEBUG   ] Got command RPT from MCS: ref #280983
2018-10-26 21:18:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 21:18:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280983  12 58417 76723949 A  ERRORBš™š'
2018-10-26 21:18:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 21:19:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 21:19:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:19:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:19:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:19:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:19:25 [WARNING ] (13, 1, 'bot')
2018-10-26 21:19:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:19:25 [DEBUG   ] Finished updating board flags in 1.453 seconds
2018-10-26 21:19:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 21:19:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 21:20:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 21:20:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:20:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 21:20:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:20:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:20:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:20:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:20:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:20:26 [DEBUG   ] Finished updating board flags in 2.161 seconds
2018-10-26 21:20:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-26 21:20:37 [DEBUG   ] Got command RPT from MCS: ref #280988
2018-10-26 21:20:37 [DEBUG   ] summary = ERROR
2018-10-26 21:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280988  13 58417 76837513 A  ERRORERROR'
2018-10-26 21:20:37 [DEBUG   ] Got command RPT from MCS: ref #280989
2018-10-26 21:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   280989  77 58417 76837514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:20:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 21:21:17 [DEBUG   ] Finished updating ant stats in 1.381 seconds
2018-10-26 21:21:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:21:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:21:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:21:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:21:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:21:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:21:26 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-10-26 21:21:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 21:21:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 21:22:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 21:22:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:22:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-26 21:22:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:22:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:22:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:22:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:22:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:22:26 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-10-26 21:22:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 21:22:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:23:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 21:23:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:23:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:23:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:23:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:23:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:23:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:23:26 [DEBUG   ] Finished updating board flags in 1.894 seconds
2018-10-26 21:23:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 21:23:43 [DEBUG   ] Got command RPT from MCS: ref #281011
2018-10-26 21:23:43 [DEBUG   ] summary = ERROR
2018-10-26 21:23:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281011  13 58417 77023233 A  ERRORERROR'
2018-10-26 21:23:43 [DEBUG   ] Got command RPT from MCS: ref #281012
2018-10-26 21:23:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:23:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281012  77 58417 77023425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:23:43 [DEBUG   ] Got command RPT from MCS: ref #281013
2018-10-26 21:23:43 [DEBUG   ] summary = ERROR
2018-10-26 21:23:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281013  13 58417 77023629 A  ERRORERROR'
2018-10-26 21:23:43 [DEBUG   ] Got command RPT from MCS: ref #281015
2018-10-26 21:23:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:23:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281015  77 58417 77023833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:23:44 [DEBUG   ] Got command RPT from MCS: ref #281017
2018-10-26 21:23:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 21:23:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281017  12 58417 77024037 A  ERRORBš™š'
2018-10-26 21:23:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 21:24:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:24:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:24:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:24:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:24:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:24:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:24:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:24:26 [DEBUG   ] Finished updating board flags in 1.693 seconds
2018-10-26 21:24:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 21:24:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 21:25:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:25:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:25:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:25:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:25:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:25:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:25:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:25:26 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-10-26 21:25:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:25:37 [DEBUG   ] Got command RPT from MCS: ref #281021
2018-10-26 21:25:37 [DEBUG   ] summary = ERROR
2018-10-26 21:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281021  13 58417 77137517 A  ERRORERROR'
2018-10-26 21:25:37 [DEBUG   ] Got command RPT from MCS: ref #281022
2018-10-26 21:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281022  77 58417 77137518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:25:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 21:26:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 21:26:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:26:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:26:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:26:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:26:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:26:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:26:26 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-10-26 21:26:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:26:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:27:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 21:27:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 21:27:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:27:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:27:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:27:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:27:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:27:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:27:26 [DEBUG   ] Finished updating board flags in 1.473 seconds
2018-10-26 21:27:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 21:27:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:28:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:28:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:28:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:28:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:28:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:28:26 [WARNING ] (13, 1, 'bot')
2018-10-26 21:28:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:28:26 [DEBUG   ] Finished updating board flags in 1.555 seconds
2018-10-26 21:28:37 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-26 21:28:43 [DEBUG   ] Got command RPT from MCS: ref #281042
2018-10-26 21:28:43 [DEBUG   ] summary = ERROR
2018-10-26 21:28:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281042  13 58417 77323313 A  ERRORERROR'
2018-10-26 21:28:43 [DEBUG   ] Got command RPT from MCS: ref #281043
2018-10-26 21:28:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:28:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281043  77 58417 77323517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:28:43 [DEBUG   ] Got command RPT from MCS: ref #281044
2018-10-26 21:28:43 [DEBUG   ] summary = ERROR
2018-10-26 21:28:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281044  13 58417 77323721 A  ERRORERROR'
2018-10-26 21:28:43 [DEBUG   ] Got command RPT from MCS: ref #281045
2018-10-26 21:28:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:28:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281045  77 58417 77323913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:28:44 [DEBUG   ] Got command RPT from MCS: ref #281046
2018-10-26 21:28:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 21:28:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281046  12 58417 77324117 A  ERRORBš™š'
2018-10-26 21:28:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 21:29:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 21:29:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:29:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:29:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:29:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:29:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:29:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:29:27 [DEBUG   ] Finished updating board flags in 2.266 seconds
2018-10-26 21:29:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 21:29:57 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-26 21:30:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 21:30:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:30:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:30:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:30:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:30:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:30:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:30:27 [DEBUG   ] Finished updating board flags in 2.133 seconds
2018-10-26 21:30:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 21:30:37 [DEBUG   ] Got command RPT from MCS: ref #281051
2018-10-26 21:30:37 [DEBUG   ] summary = ERROR
2018-10-26 21:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281051  13 58417 77437517 A  ERRORERROR'
2018-10-26 21:30:37 [DEBUG   ] Got command RPT from MCS: ref #281052
2018-10-26 21:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281052  77 58417 77437518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:30:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 21:31:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 21:31:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:31:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-26 21:31:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:31:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:31:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:31:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:31:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:31:27 [DEBUG   ] Finished updating board flags in 2.029 seconds
2018-10-26 21:31:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 21:31:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 21:32:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 21:32:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 21:32:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:32:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:32:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:32:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:32:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:32:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:32:27 [DEBUG   ] Finished updating board flags in 1.964 seconds
2018-10-26 21:32:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 21:32:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 21:33:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 21:33:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 21:33:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:33:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:33:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:33:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:33:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:33:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:33:27 [DEBUG   ] Finished updating board flags in 1.829 seconds
2018-10-26 21:33:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 21:33:43 [DEBUG   ] Got command RPT from MCS: ref #281074
2018-10-26 21:33:43 [DEBUG   ] summary = ERROR
2018-10-26 21:33:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281074  13 58417 77623409 A  ERRORERROR'
2018-10-26 21:33:43 [DEBUG   ] Got command RPT from MCS: ref #281075
2018-10-26 21:33:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:33:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281075  77 58417 77623601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:33:43 [DEBUG   ] Got command RPT from MCS: ref #281076
2018-10-26 21:33:43 [DEBUG   ] summary = ERROR
2018-10-26 21:33:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281076  13 58417 77623805 A  ERRORERROR'
2018-10-26 21:33:44 [DEBUG   ] Got command RPT from MCS: ref #281078
2018-10-26 21:33:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:33:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281078  77 58417 77624009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:33:44 [DEBUG   ] Got command RPT from MCS: ref #281080
2018-10-26 21:33:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 21:33:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281080  12 58417 77624201 A  ERRORB›™š'
2018-10-26 21:33:57 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 21:34:18 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 21:34:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:34:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:34:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:34:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:34:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:34:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:34:27 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-10-26 21:34:38 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 21:34:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 21:35:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:35:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:35:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:35:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:35:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:35:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:35:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:35:27 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-26 21:35:37 [DEBUG   ] Got command RPT from MCS: ref #281088
2018-10-26 21:35:37 [DEBUG   ] summary = ERROR
2018-10-26 21:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281088  13 58417 77737525 A  ERRORERROR'
2018-10-26 21:35:37 [DEBUG   ] Got command RPT from MCS: ref #281089
2018-10-26 21:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281089  77 58417 77737526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:35:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:35:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:36:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 21:36:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 21:36:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:36:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 21:36:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:36:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:36:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:36:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:36:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:36:27 [DEBUG   ] Finished updating board flags in 1.650 seconds
2018-10-26 21:36:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 21:36:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 21:37:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 21:37:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:37:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:37:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:37:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:37:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:37:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:37:27 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-10-26 21:37:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 21:37:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 21:38:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 21:38:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 21:38:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:38:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:38:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:38:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:38:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:38:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:38:27 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-10-26 21:38:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 21:38:43 [DEBUG   ] Got command RPT from MCS: ref #281109
2018-10-26 21:38:43 [DEBUG   ] summary = ERROR
2018-10-26 21:38:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281109  13 58417 77923497 A  ERRORERROR'
2018-10-26 21:38:43 [DEBUG   ] Got command RPT from MCS: ref #281110
2018-10-26 21:38:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:38:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281110  77 58417 77923689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:38:43 [DEBUG   ] Got command RPT from MCS: ref #281111
2018-10-26 21:38:43 [DEBUG   ] summary = ERROR
2018-10-26 21:38:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281111  13 58417 77923893 A  ERRORERROR'
2018-10-26 21:38:44 [DEBUG   ] Got command RPT from MCS: ref #281112
2018-10-26 21:38:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:38:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281112  77 58417 77924097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:38:44 [DEBUG   ] Got command RPT from MCS: ref #281113
2018-10-26 21:38:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 21:38:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281113  12 58417 77924301 A  ERRORB›™š'
2018-10-26 21:38:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 21:39:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 21:39:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:39:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:39:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:39:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:39:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:39:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:39:27 [DEBUG   ] Finished updating board flags in 1.500 seconds
2018-10-26 21:39:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 21:39:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 21:40:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 21:40:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:40:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 21:40:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 21:40:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:40:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:40:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:40:27 [WARNING ] (13, 1, 'bot')
2018-10-26 21:40:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:40:27 [DEBUG   ] Finished updating board flags in 1.532 seconds
2018-10-26 21:40:37 [DEBUG   ] Got command RPT from MCS: ref #281114
2018-10-26 21:40:37 [DEBUG   ] summary = ERROR
2018-10-26 21:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281114  13 58417 78037525 A  ERRORERROR'
2018-10-26 21:40:37 [DEBUG   ] Got command RPT from MCS: ref #281115
2018-10-26 21:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281115  77 58417 78037526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:40:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 21:40:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 21:41:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 21:41:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:41:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 21:41:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:41:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:41:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:41:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:41:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:41:28 [DEBUG   ] Finished updating board flags in 2.231 seconds
2018-10-26 21:41:38 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-26 21:41:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 21:42:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 21:42:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:42:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 21:42:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:42:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:42:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:42:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:42:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:42:28 [DEBUG   ] Finished updating board flags in 2.153 seconds
2018-10-26 21:42:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 21:42:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 21:43:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 21:43:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:43:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:43:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:43:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:43:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:43:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:43:28 [DEBUG   ] Finished updating board flags in 2.082 seconds
2018-10-26 21:43:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 21:43:43 [DEBUG   ] Got command RPT from MCS: ref #281137
2018-10-26 21:43:43 [DEBUG   ] summary = ERROR
2018-10-26 21:43:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281137  13 58417 78223577 A  ERRORERROR'
2018-10-26 21:43:43 [DEBUG   ] Got command RPT from MCS: ref #281138
2018-10-26 21:43:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:43:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281138  77 58417 78223781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:43:43 [DEBUG   ] Got command RPT from MCS: ref #281139
2018-10-26 21:43:43 [DEBUG   ] summary = ERROR
2018-10-26 21:43:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281139  13 58417 78223985 A  ERRORERROR'
2018-10-26 21:43:44 [DEBUG   ] Got command RPT from MCS: ref #281141
2018-10-26 21:43:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:43:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281141  77 58417 78224177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:43:44 [DEBUG   ] Got command RPT from MCS: ref #281142
2018-10-26 21:43:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 21:43:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281142  12 58417 78224381 A  ERRORB›™š'
2018-10-26 21:43:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 21:44:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 21:44:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:44:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 21:44:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:44:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:44:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:44:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:44:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:44:28 [DEBUG   ] Finished updating board flags in 1.907 seconds
2018-10-26 21:44:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 21:44:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 21:45:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 21:45:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:45:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:45:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:45:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:45:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:45:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:45:28 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-10-26 21:45:37 [DEBUG   ] Got command RPT from MCS: ref #281151
2018-10-26 21:45:37 [DEBUG   ] summary = ERROR
2018-10-26 21:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281151  13 58417 78337525 A  ERRORERROR'
2018-10-26 21:45:37 [DEBUG   ] Got command RPT from MCS: ref #281152
2018-10-26 21:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281152  77 58417 78337526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:45:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 21:45:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 21:46:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 21:46:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:46:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:46:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:46:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:46:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:46:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:46:28 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-10-26 21:46:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 21:46:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 21:47:18 [DEBUG   ] Finished updating ant stats in 0.466 seconds
2018-10-26 21:47:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:47:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:47:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:47:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:47:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:47:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:47:28 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-26 21:47:38 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-26 21:47:59 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2018-10-26 21:48:19 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-26 21:48:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:48:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:48:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:48:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:48:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:48:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:48:28 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-10-26 21:48:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 21:48:43 [DEBUG   ] Got command RPT from MCS: ref #281172
2018-10-26 21:48:43 [DEBUG   ] summary = ERROR
2018-10-26 21:48:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281172  13 58417 78523669 A  ERRORERROR'
2018-10-26 21:48:43 [DEBUG   ] Got command RPT from MCS: ref #281173
2018-10-26 21:48:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:48:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281173  77 58417 78523861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:48:44 [DEBUG   ] Got command RPT from MCS: ref #281174
2018-10-26 21:48:44 [DEBUG   ] summary = ERROR
2018-10-26 21:48:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281174  13 58417 78524065 A  ERRORERROR'
2018-10-26 21:48:44 [DEBUG   ] Got command RPT from MCS: ref #281175
2018-10-26 21:48:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:48:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281175  77 58417 78524269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:48:44 [DEBUG   ] Got command RPT from MCS: ref #281176
2018-10-26 21:48:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 21:48:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281176  12 58417 78524473 A  ERRORB›™š'
2018-10-26 21:48:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 21:49:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 21:49:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 21:49:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:49:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:49:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:49:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:49:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:49:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:49:28 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-10-26 21:49:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:49:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 21:50:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 21:50:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 21:50:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:50:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 21:50:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 21:50:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:50:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:50:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:50:28 [WARNING ] (13, 1, 'bot')
2018-10-26 21:50:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:50:28 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-10-26 21:50:37 [DEBUG   ] Got command RPT from MCS: ref #281181
2018-10-26 21:50:37 [DEBUG   ] summary = ERROR
2018-10-26 21:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281181  13 58417 78637525 A  ERRORERROR'
2018-10-26 21:50:37 [DEBUG   ] Got command RPT from MCS: ref #281182
2018-10-26 21:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281182  77 58417 78637526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:50:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 21:50:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:51:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:51:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:51:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 21:51:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:51:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:51:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:51:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:51:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:51:29 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-10-26 21:51:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:51:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 21:52:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:52:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:52:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 21:52:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:52:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:52:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:52:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:52:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:52:29 [DEBUG   ] Finished updating board flags in 2.144 seconds
2018-10-26 21:52:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 21:52:59 [DEBUG   ] Finished updating ant stats in 1.162 seconds
2018-10-26 21:53:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 21:53:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:53:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:53:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:53:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:53:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:53:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:53:29 [DEBUG   ] Finished updating board flags in 1.882 seconds
2018-10-26 21:53:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 21:53:43 [DEBUG   ] Got command RPT from MCS: ref #281204
2018-10-26 21:53:43 [DEBUG   ] summary = ERROR
2018-10-26 21:53:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281204  13 58417 78823753 A  ERRORERROR'
2018-10-26 21:53:43 [DEBUG   ] Got command RPT from MCS: ref #281205
2018-10-26 21:53:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:53:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281205  77 58417 78823957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:53:44 [DEBUG   ] Got command RPT from MCS: ref #281206
2018-10-26 21:53:44 [DEBUG   ] summary = ERROR
2018-10-26 21:53:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281206  13 58417 78824149 A  ERRORERROR'
2018-10-26 21:53:44 [DEBUG   ] Got command RPT from MCS: ref #281208
2018-10-26 21:53:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:53:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281208  77 58417 78824353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:53:44 [DEBUG   ] Got command RPT from MCS: ref #281209
2018-10-26 21:53:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 21:53:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281209  12 58417 78824557 A  ERRORB›™š'
2018-10-26 21:53:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 21:54:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 21:54:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:54:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:54:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:54:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:54:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:54:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:54:29 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-26 21:54:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 21:54:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 21:55:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-26 21:55:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:55:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:55:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:55:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:55:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:55:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:55:29 [DEBUG   ] Finished updating board flags in 1.777 seconds
2018-10-26 21:55:37 [DEBUG   ] Got command RPT from MCS: ref #281214
2018-10-26 21:55:37 [DEBUG   ] summary = ERROR
2018-10-26 21:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281214  13 58417 78937521 A  ERRORERROR'
2018-10-26 21:55:37 [DEBUG   ] Got command RPT from MCS: ref #281215
2018-10-26 21:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281215  77 58417 78937522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:55:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 21:55:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 21:56:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 21:56:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:56:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:56:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:56:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:56:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:56:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:56:29 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-26 21:56:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 21:56:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 21:57:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 21:57:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:57:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 21:57:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:57:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:57:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:57:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:57:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:57:29 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-10-26 21:57:39 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-26 21:58:00 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 21:58:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 21:58:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:58:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 21:58:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:58:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:58:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:58:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:58:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:58:29 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-26 21:58:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 21:58:43 [DEBUG   ] Got command RPT from MCS: ref #281235
2018-10-26 21:58:43 [DEBUG   ] summary = ERROR
2018-10-26 21:58:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281235  13 58417 79123833 A  ERRORERROR'
2018-10-26 21:58:44 [DEBUG   ] Got command RPT from MCS: ref #281236
2018-10-26 21:58:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:58:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281236  77 58417 79124037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:58:44 [DEBUG   ] Got command RPT from MCS: ref #281237
2018-10-26 21:58:44 [DEBUG   ] summary = ERROR
2018-10-26 21:58:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281237  13 58417 79124241 A  ERRORERROR'
2018-10-26 21:58:44 [DEBUG   ] Got command RPT from MCS: ref #281238
2018-10-26 21:58:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 21:58:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281238  77 58417 79124433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 21:58:44 [DEBUG   ] Got command RPT from MCS: ref #281239
2018-10-26 21:58:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 21:58:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281239  12 58417 79124637 A  ERRORB›™š'
2018-10-26 21:59:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 21:59:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 21:59:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 21:59:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 21:59:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:59:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:59:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:59:29 [WARNING ] (13, 1, 'bot')
2018-10-26 21:59:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 21:59:29 [DEBUG   ] Finished updating board flags in 1.504 seconds
2018-10-26 21:59:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 22:00:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 22:00:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 22:00:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:00:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 22:00:29 [WARNING ] (13, 1, 'bot')
2018-10-26 22:00:29 [WARNING ] (13, 1, 'bot')
2018-10-26 22:00:29 [WARNING ] (13, 1, 'bot')
2018-10-26 22:00:29 [WARNING ] (13, 1, 'bot')
2018-10-26 22:00:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:00:29 [DEBUG   ] Finished updating board flags in 1.552 seconds
2018-10-26 22:00:37 [DEBUG   ] Got command RPT from MCS: ref #281244
2018-10-26 22:00:37 [DEBUG   ] summary = ERROR
2018-10-26 22:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281244  13 58417 79237525 A  ERRORERROR'
2018-10-26 22:00:37 [DEBUG   ] Got command RPT from MCS: ref #281245
2018-10-26 22:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281245  77 58417 79237526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:00:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 22:01:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 22:01:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 22:01:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:01:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:01:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:01:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:01:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:01:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:01:30 [DEBUG   ] Finished updating board flags in 2.230 seconds
2018-10-26 22:01:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 22:02:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 22:02:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 22:02:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:02:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:02:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:02:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:02:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:02:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:02:30 [DEBUG   ] Finished updating board flags in 2.103 seconds
2018-10-26 22:02:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 22:03:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 22:03:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 22:03:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:03:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 22:03:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:03:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:03:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:03:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:03:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:03:30 [DEBUG   ] Finished updating board flags in 2.040 seconds
2018-10-26 22:03:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 22:03:43 [DEBUG   ] Got command RPT from MCS: ref #281267
2018-10-26 22:03:43 [DEBUG   ] summary = ERROR
2018-10-26 22:03:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281267  13 58417 79423918 A  ERRORERROR'
2018-10-26 22:03:44 [DEBUG   ] Got command RPT from MCS: ref #281268
2018-10-26 22:03:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:03:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281268  77 58417 79424121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:03:44 [DEBUG   ] Got command RPT from MCS: ref #281269
2018-10-26 22:03:44 [DEBUG   ] summary = ERROR
2018-10-26 22:03:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281269  13 58417 79424325 A  ERRORERROR'
2018-10-26 22:03:44 [DEBUG   ] Got command RPT from MCS: ref #281271
2018-10-26 22:03:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:03:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281271  77 58417 79424536 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:03:44 [DEBUG   ] Got command RPT from MCS: ref #281272
2018-10-26 22:03:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 22:03:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281272  12 58417 79424725 A  ERRORB›™š'
2018-10-26 22:04:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 22:04:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 22:04:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:04:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:04:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:04:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:04:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:04:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:04:30 [DEBUG   ] Finished updating board flags in 1.974 seconds
2018-10-26 22:04:40 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 22:05:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 22:05:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 22:05:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:05:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 22:05:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:05:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:05:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:05:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:05:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:05:30 [DEBUG   ] Finished updating board flags in 1.832 seconds
2018-10-26 22:05:37 [DEBUG   ] Got command RPT from MCS: ref #281281
2018-10-26 22:05:37 [DEBUG   ] summary = ERROR
2018-10-26 22:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281281  13 58417 79537521 A  ERRORERROR'
2018-10-26 22:05:37 [DEBUG   ] Got command RPT from MCS: ref #281282
2018-10-26 22:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281282  77 58417 79537522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:05:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 22:06:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 22:06:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 22:06:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:06:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:06:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:06:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:06:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:06:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:06:30 [DEBUG   ] Finished updating board flags in 1.767 seconds
2018-10-26 22:06:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 22:07:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 22:07:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 22:07:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:07:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:07:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:07:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:07:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:07:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:07:30 [DEBUG   ] Finished updating board flags in 1.715 seconds
2018-10-26 22:07:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 22:08:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 22:08:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 22:08:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:08:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 22:08:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:08:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:08:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:08:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:08:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:08:30 [DEBUG   ] Finished updating board flags in 1.496 seconds
2018-10-26 22:08:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 22:08:44 [DEBUG   ] Got command RPT from MCS: ref #281302
2018-10-26 22:08:44 [DEBUG   ] summary = ERROR
2018-10-26 22:08:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281302  13 58417 79724009 A  ERRORERROR'
2018-10-26 22:08:44 [DEBUG   ] Got command RPT from MCS: ref #281303
2018-10-26 22:08:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:08:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281303  77 58417 79724213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:08:44 [DEBUG   ] Got command RPT from MCS: ref #281304
2018-10-26 22:08:44 [DEBUG   ] summary = ERROR
2018-10-26 22:08:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281304  13 58417 79724417 A  ERRORERROR'
2018-10-26 22:08:44 [DEBUG   ] Got command RPT from MCS: ref #281305
2018-10-26 22:08:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:08:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281305  77 58417 79724609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:08:44 [DEBUG   ] Got command RPT from MCS: ref #281306
2018-10-26 22:08:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 22:08:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281306  12 58417 79724813 A  ERRORB›™š'
2018-10-26 22:09:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 22:09:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 22:09:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:09:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:09:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:09:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:09:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:09:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:09:30 [DEBUG   ] Finished updating board flags in 1.500 seconds
2018-10-26 22:09:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-26 22:10:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 22:10:20 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-26 22:10:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:10:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 22:10:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:10:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:10:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:10:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:10:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:10:30 [DEBUG   ] Finished updating board flags in 1.503 seconds
2018-10-26 22:10:37 [DEBUG   ] Got command RPT from MCS: ref #281307
2018-10-26 22:10:37 [DEBUG   ] summary = ERROR
2018-10-26 22:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281307  13 58417 79837533 A  ERRORERROR'
2018-10-26 22:10:37 [DEBUG   ] Got command RPT from MCS: ref #281308
2018-10-26 22:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281308  77 58417 79837534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:10:41 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-10-26 22:11:01 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-26 22:11:21 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 22:11:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:11:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:11:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:11:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:11:30 [WARNING ] (13, 1, 'bot')
2018-10-26 22:11:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:11:30 [DEBUG   ] Finished updating board flags in 1.501 seconds
2018-10-26 22:11:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 22:12:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 22:12:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 22:12:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:12:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 22:12:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:12:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:12:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:12:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:12:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:12:31 [DEBUG   ] Finished updating board flags in 2.153 seconds
2018-10-26 22:12:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 22:13:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 22:13:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 22:13:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 22:13:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:13:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:13:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:13:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:13:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:13:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:13:31 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-10-26 22:13:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 22:13:44 [DEBUG   ] Got command RPT from MCS: ref #281330
2018-10-26 22:13:44 [DEBUG   ] summary = ERROR
2018-10-26 22:13:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281330  13 58417 80024093 A  ERRORERROR'
2018-10-26 22:13:44 [DEBUG   ] Got command RPT from MCS: ref #281331
2018-10-26 22:13:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:13:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281331  77 58417 80024297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:13:44 [DEBUG   ] Got command RPT from MCS: ref #281332
2018-10-26 22:13:44 [DEBUG   ] summary = ERROR
2018-10-26 22:13:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281332  13 58417 80024501 A  ERRORERROR'
2018-10-26 22:13:44 [DEBUG   ] Got command RPT from MCS: ref #281334
2018-10-26 22:13:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:13:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281334  77 58417 80024693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:13:44 [DEBUG   ] Got command RPT from MCS: ref #281335
2018-10-26 22:13:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 22:13:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281335  12 58417 80024897 A  ERRORB›™š'
2018-10-26 22:14:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 22:14:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 22:14:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:14:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 22:14:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:14:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:14:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:14:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:14:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:14:31 [DEBUG   ] Finished updating board flags in 1.971 seconds
2018-10-26 22:14:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 22:15:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 22:15:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 22:15:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:15:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:15:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:15:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:15:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:15:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:15:31 [DEBUG   ] Finished updating board flags in 1.898 seconds
2018-10-26 22:15:37 [DEBUG   ] Got command RPT from MCS: ref #281344
2018-10-26 22:15:37 [DEBUG   ] summary = ERROR
2018-10-26 22:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281344  13 58417 80137525 A  ERRORERROR'
2018-10-26 22:15:37 [DEBUG   ] Got command RPT from MCS: ref #281345
2018-10-26 22:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281345  77 58417 80137526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:15:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 22:16:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-26 22:16:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 22:16:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 22:16:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:16:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 22:16:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:16:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:16:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:16:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:16:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:16:31 [DEBUG   ] Finished updating board flags in 1.724 seconds
2018-10-26 22:16:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 22:17:01 [DEBUG   ] Finished updating ant stats in 0.877 seconds
2018-10-26 22:17:21 [DEBUG   ] Finished updating ant stats in 0.727 seconds
2018-10-26 22:17:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:17:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:17:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:17:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:17:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:17:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:17:31 [DEBUG   ] Finished updating board flags in 1.601 seconds
2018-10-26 22:17:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 22:18:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 22:18:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 22:18:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:18:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:18:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:18:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:18:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:18:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:18:31 [DEBUG   ] Finished updating board flags in 1.585 seconds
2018-10-26 22:18:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 22:18:44 [DEBUG   ] Got command RPT from MCS: ref #281365
2018-10-26 22:18:44 [DEBUG   ] summary = ERROR
2018-10-26 22:18:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281365  13 58417 80324173 A  ERRORERROR'
2018-10-26 22:18:44 [DEBUG   ] Got command RPT from MCS: ref #281366
2018-10-26 22:18:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:18:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281366  77 58417 80324377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:18:44 [DEBUG   ] Got command RPT from MCS: ref #281367
2018-10-26 22:18:44 [DEBUG   ] summary = ERROR
2018-10-26 22:18:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281367  13 58417 80324581 A  ERRORERROR'
2018-10-26 22:18:44 [DEBUG   ] Got command RPT from MCS: ref #281368
2018-10-26 22:18:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:18:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281368  77 58417 80324785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:18:44 [DEBUG   ] Got command RPT from MCS: ref #281369
2018-10-26 22:18:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 22:18:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281369  12 58417 80324977 A  ERRORB›™š'
2018-10-26 22:19:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 22:19:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 22:19:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:19:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:19:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:19:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:19:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:19:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:19:31 [DEBUG   ] Finished updating board flags in 1.467 seconds
2018-10-26 22:19:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 22:20:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 22:20:21 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-26 22:20:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:20:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 22:20:31 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 22:20:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:20:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:20:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:20:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:20:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:20:31 [DEBUG   ] Finished updating board flags in 1.474 seconds
2018-10-26 22:20:37 [DEBUG   ] Got command RPT from MCS: ref #281374
2018-10-26 22:20:37 [DEBUG   ] summary = ERROR
2018-10-26 22:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281374  13 58417 80437525 A  ERRORERROR'
2018-10-26 22:20:37 [DEBUG   ] Got command RPT from MCS: ref #281375
2018-10-26 22:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281375  77 58417 80437526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:20:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 22:21:01 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-26 22:21:22 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-26 22:21:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:21:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 22:21:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:21:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:21:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:21:31 [WARNING ] (13, 1, 'bot')
2018-10-26 22:21:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:21:31 [DEBUG   ] Finished updating board flags in 1.475 seconds
2018-10-26 22:21:42 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 22:22:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 22:22:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 22:22:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:22:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:22:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:22:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:22:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:22:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:22:32 [DEBUG   ] Finished updating board flags in 2.194 seconds
2018-10-26 22:22:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 22:23:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 22:23:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 22:23:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:23:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:23:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:23:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:23:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:23:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:23:32 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-10-26 22:23:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 22:23:44 [DEBUG   ] Got command RPT from MCS: ref #281397
2018-10-26 22:23:44 [DEBUG   ] summary = ERROR
2018-10-26 22:23:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281397  13 58417 80624262 A  ERRORERROR'
2018-10-26 22:23:44 [DEBUG   ] Got command RPT from MCS: ref #281398
2018-10-26 22:23:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:23:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281398  77 58417 80624465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:23:44 [DEBUG   ] Got command RPT from MCS: ref #281399
2018-10-26 22:23:44 [DEBUG   ] summary = ERROR
2018-10-26 22:23:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281399  13 58417 80624657 A  ERRORERROR'
2018-10-26 22:23:44 [DEBUG   ] Got command RPT from MCS: ref #281400
2018-10-26 22:23:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:23:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281400  77 58417 80624861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:23:45 [DEBUG   ] Got command RPT from MCS: ref #281402
2018-10-26 22:23:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 22:23:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281402  12 58417 80625065 A  ERRORB›™š'
2018-10-26 22:24:02 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-10-26 22:24:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 22:24:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:24:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:24:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:24:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:24:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:24:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:24:32 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-10-26 22:24:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 22:25:02 [DEBUG   ] Finished updating ant stats in 0.590 seconds
2018-10-26 22:25:23 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 22:25:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:25:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:25:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:25:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:25:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:25:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:25:32 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-26 22:25:37 [DEBUG   ] Got command RPT from MCS: ref #281407
2018-10-26 22:25:37 [DEBUG   ] summary = ERROR
2018-10-26 22:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281407  13 58417 80737537 A  ERRORERROR'
2018-10-26 22:25:37 [DEBUG   ] Got command RPT from MCS: ref #281408
2018-10-26 22:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281408  77 58417 80737538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:25:43 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 22:26:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 22:26:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 22:26:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:26:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:26:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:26:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:26:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:26:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:26:32 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-26 22:26:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 22:27:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 22:27:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 22:27:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:27:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 22:27:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:27:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:27:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:27:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:27:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:27:32 [DEBUG   ] Finished updating board flags in 1.703 seconds
2018-10-26 22:27:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 22:28:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 22:28:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 22:28:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-26 22:28:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:28:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:28:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:28:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:28:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:28:32 [DEBUG   ] Finished updating board flags in 1.514 seconds
2018-10-26 22:28:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 22:28:44 [DEBUG   ] Got command RPT from MCS: ref #281428
2018-10-26 22:28:44 [DEBUG   ] summary = ERROR
2018-10-26 22:28:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281428  13 58417 80924357 A  ERRORERROR'
2018-10-26 22:28:44 [DEBUG   ] Got command RPT from MCS: ref #281429
2018-10-26 22:28:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:28:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281429  77 58417 80924561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:28:44 [DEBUG   ] Got command RPT from MCS: ref #281430
2018-10-26 22:28:44 [DEBUG   ] summary = ERROR
2018-10-26 22:28:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281430  13 58417 80924753 A  ERRORERROR'
2018-10-26 22:28:44 [DEBUG   ] Got command RPT from MCS: ref #281431
2018-10-26 22:28:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:28:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281431  77 58417 80924957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:28:45 [DEBUG   ] Got command RPT from MCS: ref #281432
2018-10-26 22:28:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 22:28:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281432  12 58417 80925161 A  ERRORBœ™š'
2018-10-26 22:29:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 22:29:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 22:29:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:29:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:29:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:29:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:29:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:29:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:29:32 [DEBUG   ] Finished updating board flags in 1.473 seconds
2018-10-26 22:29:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-26 22:30:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 22:30:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-26 22:30:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:30:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:30:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:30:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:30:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:30:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:30:32 [DEBUG   ] Finished updating board flags in 1.484 seconds
2018-10-26 22:30:37 [DEBUG   ] Got command RPT from MCS: ref #281437
2018-10-26 22:30:37 [DEBUG   ] summary = ERROR
2018-10-26 22:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281437  13 58417 81037529 A  ERRORERROR'
2018-10-26 22:30:37 [DEBUG   ] Got command RPT from MCS: ref #281438
2018-10-26 22:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281438  77 58417 81037530 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:30:43 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 22:31:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 22:31:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 22:31:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:31:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:31:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:31:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:31:32 [WARNING ] (13, 1, 'bot')
2018-10-26 22:31:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:31:32 [DEBUG   ] Finished updating board flags in 1.469 seconds
2018-10-26 22:31:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 22:32:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 22:32:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 22:32:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 22:32:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:32:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:32:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:32:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:32:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:32:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:32:33 [DEBUG   ] Finished updating board flags in 2.209 seconds
2018-10-26 22:32:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-26 22:33:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 22:33:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 22:33:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:33:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 22:33:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:33:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:33:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:33:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:33:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:33:33 [DEBUG   ] Finished updating board flags in 2.147 seconds
2018-10-26 22:33:44 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-26 22:33:44 [DEBUG   ] Got command RPT from MCS: ref #281460
2018-10-26 22:33:44 [DEBUG   ] summary = ERROR
2018-10-26 22:33:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281460  13 58417 81224437 A  ERRORERROR'
2018-10-26 22:33:44 [DEBUG   ] Got command RPT from MCS: ref #281461
2018-10-26 22:33:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:33:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281461  77 58417 81224641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:33:44 [DEBUG   ] Got command RPT from MCS: ref #281462
2018-10-26 22:33:44 [DEBUG   ] summary = ERROR
2018-10-26 22:33:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281462  13 58417 81224845 A  ERRORERROR'
2018-10-26 22:33:45 [DEBUG   ] Got command RPT from MCS: ref #281464
2018-10-26 22:33:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:33:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281464  77 58417 81225037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:33:45 [DEBUG   ] Got command RPT from MCS: ref #281466
2018-10-26 22:33:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 22:33:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281466  12 58417 81225241 A  ERRORBœ™š'
2018-10-26 22:34:04 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 22:34:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 22:34:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:34:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:34:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:34:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:34:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:34:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:34:33 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-10-26 22:34:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 22:35:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 22:35:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 22:35:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:35:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:35:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:35:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:35:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:35:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:35:33 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-10-26 22:35:37 [DEBUG   ] Got command RPT from MCS: ref #281474
2018-10-26 22:35:37 [DEBUG   ] summary = ERROR
2018-10-26 22:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281474  13 58417 81337533 A  ERRORERROR'
2018-10-26 22:35:37 [DEBUG   ] Got command RPT from MCS: ref #281475
2018-10-26 22:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281475  77 58417 81337534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:35:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 22:36:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 22:36:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 22:36:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:36:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:36:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:36:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:36:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:36:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:36:33 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-10-26 22:36:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 22:37:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 22:37:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 22:37:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:37:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:37:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:37:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:37:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:37:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:37:33 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-10-26 22:37:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 22:38:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 22:38:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 22:38:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:38:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 22:38:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:38:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:38:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:38:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:38:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:38:33 [DEBUG   ] Finished updating board flags in 1.893 seconds
2018-10-26 22:38:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 22:38:44 [DEBUG   ] Got command RPT from MCS: ref #281495
2018-10-26 22:38:44 [DEBUG   ] summary = ERROR
2018-10-26 22:38:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281495  13 58417 81524521 A  ERRORERROR'
2018-10-26 22:38:44 [DEBUG   ] Got command RPT from MCS: ref #281496
2018-10-26 22:38:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:38:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281496  77 58417 81524725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:38:44 [DEBUG   ] Got command RPT from MCS: ref #281497
2018-10-26 22:38:44 [DEBUG   ] summary = ERROR
2018-10-26 22:38:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281497  13 58417 81524929 A  ERRORERROR'
2018-10-26 22:38:45 [DEBUG   ] Got command RPT from MCS: ref #281498
2018-10-26 22:38:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:38:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281498  77 58417 81525121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:38:45 [DEBUG   ] Got command RPT from MCS: ref #281499
2018-10-26 22:38:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 22:38:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281499  12 58417 81525325 A  ERRORBœ™š'
2018-10-26 22:39:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 22:39:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 22:39:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:39:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:39:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:39:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:39:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:39:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:39:33 [DEBUG   ] Finished updating board flags in 1.719 seconds
2018-10-26 22:39:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 22:40:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 22:40:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 22:40:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:40:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:40:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:40:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:40:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:40:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:40:33 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-10-26 22:40:37 [DEBUG   ] Got command RPT from MCS: ref #281500
2018-10-26 22:40:37 [DEBUG   ] summary = ERROR
2018-10-26 22:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281500  13 58417 81637529 A  ERRORERROR'
2018-10-26 22:40:37 [DEBUG   ] Got command RPT from MCS: ref #281501
2018-10-26 22:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281501  77 58417 81637530 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:40:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 22:41:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 22:41:11 [DEBUG   ] Got command TBW from MCS: ref #281522
2018-10-26 22:41:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-10-26 22:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   281522   8 58417 81671262 A  ERROR'
2018-10-26 22:41:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-10-26 22:41:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-10-26 22:41:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-10-26 22:41:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-10-26 22:41:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-10-26 22:41:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-10-26 22:41:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-10-26 22:41:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-10-26 22:41:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-10-26 22:41:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-10-26 22:41:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-10-26 22:41:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-10-26 22:41:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-10-26 22:41:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-10-26 22:41:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-10-26 22:41:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-10-26 22:41:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-10-26 22:41:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-10-26 22:41:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-10-26 22:41:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-10-26 22:41:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-10-26 22:41:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-10-26 22:41:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-10-26 22:41:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-10-26 22:41:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-10-26 22:41:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-10-26 22:41:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-10-26 22:41:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-10-26 22:41:14 [DEBUG   ] spawn_process: at 2018-10-26 22:41:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-10-26 22:41:14 [INFO    ] Finished spawning TBW
2018-10-26 22:41:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:41:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:41:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:41:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:41:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:41:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:41:33 [DEBUG   ] Finished updating board flags in 1.203 seconds
2018-10-26 22:42:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:42:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:42:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:42:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:42:33 [WARNING ] (13, 1, 'bot')
2018-10-26 22:42:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:42:33 [DEBUG   ] Finished updating board flags in 1.359 seconds
2018-10-26 22:43:02 [INFO    ] __waitForTBW - TBW finished in 108.094 s
2018-10-26 22:43:03 [DEBUG   ] Finished updating ant stats in 0.420 seconds
2018-10-26 22:43:03 [INFO    ] Started antennas statistics background thread
2018-10-26 22:43:03 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540593785']
2018-10-26 22:43:03 [DEBUG   ] spawn_process: at 2018-10-26 22:43:03 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540593785']
2018-10-26 22:43:03 [INFO    ] Finished spawning TBN in 0.054 s
2018-10-26 22:43:23 [DEBUG   ] Finished updating ant stats in 0.469 seconds
2018-10-26 22:43:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:43:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:43:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:43:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:43:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:43:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:43:34 [DEBUG   ] Finished updating board flags in 1.639 seconds
2018-10-26 22:43:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-26 22:43:44 [DEBUG   ] Got command RPT from MCS: ref #281532
2018-10-26 22:43:44 [DEBUG   ] summary = ERROR
2018-10-26 22:43:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281532  13 58417 81824605 A  ERRORERROR'
2018-10-26 22:43:44 [DEBUG   ] Got command RPT from MCS: ref #281533
2018-10-26 22:43:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:43:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281533  77 58417 81824809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:43:45 [DEBUG   ] Got command RPT from MCS: ref #281534
2018-10-26 22:43:45 [DEBUG   ] summary = ERROR
2018-10-26 22:43:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281534  13 58417 81825013 A  ERRORERROR'
2018-10-26 22:43:45 [DEBUG   ] Got command RPT from MCS: ref #281536
2018-10-26 22:43:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:43:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281536  77 58417 81825217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:43:45 [DEBUG   ] Got command RPT from MCS: ref #281537
2018-10-26 22:43:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 22:43:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281537  12 58417 81825409 A  ERRORB›™š'
2018-10-26 22:44:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-26 22:44:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 22:44:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:44:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 22:44:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:44:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:44:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:44:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:44:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:44:34 [DEBUG   ] Finished updating board flags in 2.339 seconds
2018-10-26 22:44:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 22:45:04 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-26 22:45:24 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-26 22:45:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:45:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:45:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:45:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:45:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:45:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:45:34 [DEBUG   ] Finished updating board flags in 2.066 seconds
2018-10-26 22:45:37 [DEBUG   ] Got command RPT from MCS: ref #281546
2018-10-26 22:45:37 [DEBUG   ] summary = ERROR
2018-10-26 22:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281546  13 58417 81937533 A  ERRORERROR'
2018-10-26 22:45:37 [DEBUG   ] Got command RPT from MCS: ref #281547
2018-10-26 22:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281547  77 58417 81937534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:45:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 22:46:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 22:46:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 22:46:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:46:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 22:46:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:46:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:46:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:46:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:46:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:46:34 [DEBUG   ] Finished updating board flags in 1.999 seconds
2018-10-26 22:46:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 22:47:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 22:47:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 22:47:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:47:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:47:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:47:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:47:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:47:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:47:34 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-26 22:47:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 22:48:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 22:48:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 22:48:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:48:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:48:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:48:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:48:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:48:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:48:34 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-10-26 22:48:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 22:48:44 [DEBUG   ] Got command RPT from MCS: ref #281567
2018-10-26 22:48:44 [DEBUG   ] summary = ERROR
2018-10-26 22:48:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281567  13 58417 82124693 A  ERRORERROR'
2018-10-26 22:48:44 [DEBUG   ] Got command RPT from MCS: ref #281568
2018-10-26 22:48:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:48:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281568  77 58417 82124897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:48:45 [DEBUG   ] Got command RPT from MCS: ref #281569
2018-10-26 22:48:45 [DEBUG   ] summary = ERROR
2018-10-26 22:48:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281569  13 58417 82125101 A  ERRORERROR'
2018-10-26 22:48:45 [DEBUG   ] Got command RPT from MCS: ref #281570
2018-10-26 22:48:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:48:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281570  77 58417 82125293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:48:45 [DEBUG   ] Got command RPT from MCS: ref #281571
2018-10-26 22:48:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 22:48:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281571  12 58417 82125497 A  ERRORBœ™š'
2018-10-26 22:49:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 22:49:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 22:49:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-26 22:49:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:49:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:49:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:49:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:49:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:49:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:49:34 [DEBUG   ] Finished updating board flags in 1.716 seconds
2018-10-26 22:49:44 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-26 22:50:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 22:50:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-26 22:50:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:50:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:50:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:50:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:50:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:50:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:50:34 [DEBUG   ] Finished updating board flags in 1.500 seconds
2018-10-26 22:50:37 [DEBUG   ] Got command RPT from MCS: ref #281576
2018-10-26 22:50:37 [DEBUG   ] summary = ERROR
2018-10-26 22:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281576  13 58417 82237537 A  ERRORERROR'
2018-10-26 22:50:37 [DEBUG   ] Got command RPT from MCS: ref #281577
2018-10-26 22:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281577  77 58417 82237538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:50:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 22:51:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 22:51:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 22:51:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:51:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:51:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:51:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:51:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:51:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:51:34 [DEBUG   ] Finished updating board flags in 1.451 seconds
2018-10-26 22:51:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 22:52:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 22:52:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 22:52:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:52:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:52:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:52:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:52:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:52:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:52:34 [DEBUG   ] Finished updating board flags in 1.476 seconds
2018-10-26 22:52:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 22:53:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 22:53:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 22:53:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:53:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:53:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:53:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:53:34 [WARNING ] (13, 1, 'bot')
2018-10-26 22:53:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:53:34 [DEBUG   ] Finished updating board flags in 1.490 seconds
2018-10-26 22:53:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 22:53:44 [DEBUG   ] Got command RPT from MCS: ref #281599
2018-10-26 22:53:44 [DEBUG   ] summary = ERROR
2018-10-26 22:53:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281599  13 58417 82424777 A  ERRORERROR'
2018-10-26 22:53:44 [DEBUG   ] Got command RPT from MCS: ref #281600
2018-10-26 22:53:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:53:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281600  77 58417 82424981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:53:45 [DEBUG   ] Got command RPT from MCS: ref #281601
2018-10-26 22:53:45 [DEBUG   ] summary = ERROR
2018-10-26 22:53:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281601  13 58417 82425185 A  ERRORERROR'
2018-10-26 22:53:45 [DEBUG   ] Got command RPT from MCS: ref #281603
2018-10-26 22:53:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:53:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281603  77 58417 82425377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:53:45 [DEBUG   ] Got command RPT from MCS: ref #281604
2018-10-26 22:53:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 22:53:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281604  12 58417 82425581 A  ERRORB›™š'
2018-10-26 22:54:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 22:54:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 22:54:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:54:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:54:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:54:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:54:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:54:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:54:35 [DEBUG   ] Finished updating board flags in 2.205 seconds
2018-10-26 22:54:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 22:55:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 22:55:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 22:55:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:55:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 22:55:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:55:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:55:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:55:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:55:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:55:35 [DEBUG   ] Finished updating board flags in 2.274 seconds
2018-10-26 22:55:37 [DEBUG   ] Got command RPT from MCS: ref #281609
2018-10-26 22:55:37 [DEBUG   ] summary = ERROR
2018-10-26 22:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281609  13 58417 82537533 A  ERRORERROR'
2018-10-26 22:55:37 [DEBUG   ] Got command RPT from MCS: ref #281610
2018-10-26 22:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281610  77 58417 82537534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:55:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 22:56:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 22:56:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 22:56:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:56:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:56:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:56:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:56:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:56:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:56:35 [DEBUG   ] Finished updating board flags in 2.137 seconds
2018-10-26 22:56:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 22:57:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 22:57:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 22:57:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:57:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:57:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:57:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:57:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:57:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:57:35 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-10-26 22:57:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 22:58:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 22:58:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 22:58:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:58:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:58:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:58:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:58:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:58:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:58:35 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-10-26 22:58:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 22:58:44 [DEBUG   ] Got command RPT from MCS: ref #281630
2018-10-26 22:58:44 [DEBUG   ] summary = ERROR
2018-10-26 22:58:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281630  13 58417 82724869 A  ERRORERROR'
2018-10-26 22:58:45 [DEBUG   ] Got command RPT from MCS: ref #281631
2018-10-26 22:58:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:58:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281631  77 58417 82725061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:58:45 [DEBUG   ] Got command RPT from MCS: ref #281632
2018-10-26 22:58:45 [DEBUG   ] summary = ERROR
2018-10-26 22:58:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281632  13 58417 82725265 A  ERRORERROR'
2018-10-26 22:58:45 [DEBUG   ] Got command RPT from MCS: ref #281633
2018-10-26 22:58:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 22:58:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281633  77 58417 82725469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 22:58:45 [DEBUG   ] Got command RPT from MCS: ref #281634
2018-10-26 22:58:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 22:58:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281634  12 58417 82725661 A  ERRORB›™š'
2018-10-26 22:59:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 22:59:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 22:59:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 22:59:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:59:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:59:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:59:35 [WARNING ] (13, 1, 'bot')
2018-10-26 22:59:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 22:59:35 [DEBUG   ] Finished updating board flags in 1.948 seconds
2018-10-26 22:59:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 23:00:04 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 23:00:24 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-26 23:00:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:00:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:00:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:00:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:00:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:00:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:00:35 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-26 23:00:37 [DEBUG   ] Got command RPT from MCS: ref #281639
2018-10-26 23:00:37 [DEBUG   ] summary = ERROR
2018-10-26 23:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281639  13 58417 82837537 A  ERRORERROR'
2018-10-26 23:00:37 [DEBUG   ] Got command RPT from MCS: ref #281640
2018-10-26 23:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281640  77 58417 82837538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:00:45 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-26 23:01:05 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-26 23:01:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 23:01:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:01:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 23:01:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:01:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:01:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:01:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:01:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:01:35 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-26 23:01:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 23:02:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-26 23:02:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 23:02:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:02:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:02:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:02:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:02:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:02:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:02:35 [DEBUG   ] Finished updating board flags in 1.657 seconds
2018-10-26 23:02:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 23:03:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 23:03:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 23:03:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:03:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:03:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:03:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:03:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:03:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:03:35 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-10-26 23:03:44 [DEBUG   ] Got command RPT from MCS: ref #281662
2018-10-26 23:03:44 [DEBUG   ] summary = ERROR
2018-10-26 23:03:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281662  13 58417 83024945 A  ERRORERROR'
2018-10-26 23:03:45 [DEBUG   ] Got command RPT from MCS: ref #281663
2018-10-26 23:03:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:03:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281663  77 58417 83025149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:03:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 23:03:45 [DEBUG   ] Got command RPT from MCS: ref #281664
2018-10-26 23:03:45 [DEBUG   ] summary = ERROR
2018-10-26 23:03:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281664  13 58417 83025353 A  ERRORERROR'
2018-10-26 23:03:45 [DEBUG   ] Got command RPT from MCS: ref #281665
2018-10-26 23:03:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:03:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281665  77 58417 83025545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:03:45 [DEBUG   ] Got command RPT from MCS: ref #281667
2018-10-26 23:03:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 23:03:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281667  12 58417 83025749 A  ERRORBœ™š'
2018-10-26 23:04:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 23:04:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 23:04:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:04:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:04:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:04:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:04:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:04:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:04:35 [DEBUG   ] Finished updating board flags in 1.630 seconds
2018-10-26 23:04:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-26 23:05:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 23:05:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 23:05:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:05:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:05:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:05:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:05:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:05:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:05:35 [DEBUG   ] Finished updating board flags in 1.513 seconds
2018-10-26 23:05:37 [DEBUG   ] Got command RPT from MCS: ref #281676
2018-10-26 23:05:37 [DEBUG   ] summary = ERROR
2018-10-26 23:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281676  13 58417 83137541 A  ERRORERROR'
2018-10-26 23:05:37 [DEBUG   ] Got command RPT from MCS: ref #281677
2018-10-26 23:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281677  77 58417 83137542 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:05:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-26 23:06:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 23:06:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 23:06:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:06:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:06:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:06:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:06:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:06:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:06:35 [DEBUG   ] Finished updating board flags in 1.402 seconds
2018-10-26 23:06:45 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 23:07:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 23:07:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 23:07:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:07:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 23:07:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:07:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:07:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:07:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:07:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:07:35 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-26 23:07:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 23:08:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 23:08:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-26 23:08:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:08:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:08:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:08:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:08:35 [WARNING ] (13, 1, 'bot')
2018-10-26 23:08:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:08:35 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-26 23:08:45 [DEBUG   ] Got command RPT from MCS: ref #281697
2018-10-26 23:08:45 [DEBUG   ] summary = ERROR
2018-10-26 23:08:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281697  13 58417 83325029 A  ERRORERROR'
2018-10-26 23:08:45 [DEBUG   ] Got command RPT from MCS: ref #281698
2018-10-26 23:08:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:08:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281698  77 58417 83325233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:08:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-26 23:08:45 [DEBUG   ] Got command RPT from MCS: ref #281699
2018-10-26 23:08:45 [DEBUG   ] summary = ERROR
2018-10-26 23:08:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281699  13 58417 83325437 A  ERRORERROR'
2018-10-26 23:08:45 [DEBUG   ] Got command RPT from MCS: ref #281700
2018-10-26 23:08:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:08:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281700  77 58417 83325629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:08:45 [DEBUG   ] Got command RPT from MCS: ref #281701
2018-10-26 23:08:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 23:08:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281701  12 58417 83325833 A  ERRORBœ™š'
2018-10-26 23:09:00 [DEBUG   ] Got command RPT from MCS: ref #281702
2018-10-26 23:09:00 [DEBUG   ] summary = ERROR
2018-10-26 23:09:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281702  13 58417 83340785 A  ERRORERROR'
2018-10-26 23:09:00 [DEBUG   ] Got command RPT from MCS: ref #281703
2018-10-26 23:09:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:09:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281703  77 58417 83340786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:09:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 23:09:05 [DEBUG   ] Got command INI from MCS: ref #281704
2018-10-26 23:09:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-10-26 23:09:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   281704   8 58417 83345798 ABOOTING'
2018-10-26 23:09:29 [INFO    ] -------------------
2018-10-26 23:09:29 [INFO    ]  LWA board status
2018-10-26 23:09:29 [INFO    ] -------------------
2018-10-26 23:09:29 [INFO    ] DP 1: 2 lwa27
2018-10-26 23:09:29 [INFO    ] DP 1: 3 lwa24
2018-10-26 23:09:29 [INFO    ] DP 1: 4 lwa23
2018-10-26 23:09:29 [INFO    ] DP 1: 5 lwa18
2018-10-26 23:09:29 [INFO    ] DP 1: 6 lwa10
2018-10-26 23:09:29 [INFO    ] DP 1: 7 lwa32
2018-10-26 23:09:29 [INFO    ] DP 1: 8 lwa11
2018-10-26 23:09:29 [INFO    ] DP 1: 9 lwa30
2018-10-26 23:09:29 [INFO    ] DP 1: 10 lwa12
2018-10-26 23:09:29 [INFO    ] DP 1: 11 lwa8
2018-10-26 23:09:29 [INFO    ] DP 1: 12 lwa13
2018-10-26 23:09:29 [INFO    ] DP 1: 13 lwa26
2018-10-26 23:09:29 [INFO    ] DP 1: 14 lwa14
2018-10-26 23:09:29 [INFO    ] DP 1: 16 lwa22
2018-10-26 23:09:29 [INFO    ] DP 1: 17 lwa20
2018-10-26 23:09:29 [INFO    ] DP 1: 18 lwa1
2018-10-26 23:09:29 [INFO    ] DP 1: 19 lwa5
2018-10-26 23:09:29 [INFO    ] DP 1: 20 lwa25
2018-10-26 23:09:29 [INFO    ] DP 1: 21 lwa35
2018-10-26 23:09:29 [INFO    ] DP 1: 22 lwa19
2018-10-26 23:09:29 [INFO    ] DP 1: 23 lwa21
2018-10-26 23:09:29 [INFO    ] DP 1: 24 lwa6
2018-10-26 23:09:29 [INFO    ] DP 1: 25 lwa7
2018-10-26 23:09:29 [INFO    ] DP 1: 26 lwa33
2018-10-26 23:09:29 [INFO    ] DP 1: 27 lwa15
2018-10-26 23:09:29 [INFO    ] DP 1: 28 lwa28
2018-10-26 23:09:29 [INFO    ] DP 2: 1 lwa16
2018-10-26 23:09:29 [INFO    ] DP 2: 15 lwa34
2018-10-26 23:09:29 [INFO    ] Total of 28 boards
2018-10-26 23:09:29 [INFO    ] Total of 260 stands
2018-10-26 23:09:29 [INFO    ] -------------------
2018-10-26 23:09:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30493
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30494
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30495
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30496
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30497
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30498
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30499
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30500
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30501
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30502
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30503
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30504
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30505
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30506
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30507
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30508
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30509
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30510
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30511
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30512
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30513
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30514
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30515
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30516
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30517
2018-10-26 23:09:36 [DEBUG   ] 2018-10-26 23:09:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30518
2018-10-26 23:09:48 [DEBUG   ] 2018-10-26 23:09:48 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30493 exited with status 0
2018-10-26 23:09:48 [DEBUG   ] 2018-10-26 23:09:48 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30494 exited with status 0
2018-10-26 23:09:48 [DEBUG   ] 2018-10-26 23:09:48 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30495 exited with status 0
2018-10-26 23:09:48 [DEBUG   ] 2018-10-26 23:09:48 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30496 exited with status 0
2018-10-26 23:09:48 [DEBUG   ] 2018-10-26 23:09:48 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30497 exited with status 0
2018-10-26 23:09:48 [DEBUG   ] 2018-10-26 23:09:48 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30498 exited with status 0
2018-10-26 23:09:48 [DEBUG   ] 2018-10-26 23:09:48 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30499 exited with status 0
2018-10-26 23:09:48 [DEBUG   ] 2018-10-26 23:09:48 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30500 exited with status 0
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30501 exited with status 0
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30502 exited with status 0
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30503 exited with status 0
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30504 exited with status 0
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30505 exited with status 0
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30506 exited with status 0
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30507 exited with status 0
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30508 exited with status 0
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30509 exited with status 0
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30510 exited with status 0
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30511 exited with status 0
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30512 exited with status 0
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30513 exited with status 0
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30514 exited with status 0
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30515 exited with status 0
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30516 exited with status 0
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30517 exited with status 0
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30518 exited with status 0
2018-10-26 23:09:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] spawn_process: at 2018-10-26 23:09:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 30545
2018-10-26 23:09:49 [DEBUG   ] 2018-10-26 23:09:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 30546
2018-10-26 23:09:54 [DEBUG   ] 2018-10-26 23:09:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 30545 exited with status 0
2018-10-26 23:09:54 [DEBUG   ] 2018-10-26 23:09:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 30546 exited with status 0
2018-10-26 23:09:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-10-26 23:09:54 [DEBUG   ] spawn_process: at 2018-10-26 23:09:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-10-26 23:09:54 [DEBUG   ] spawn_process: at 2018-10-26 23:09:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-10-26 23:09:54 [INFO    ] Setting Beam 1 xbars
2018-10-26 23:09:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-10-26 23:09:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-10-26 23:09:54 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-10-26 23:09:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-10-26 23:09:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-10-26 23:09:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-10-26 23:09:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-10-26 23:09:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-10-26 23:09:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-10-26 23:09:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-10-26 23:09:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-10-26 23:09:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-10-26 23:09:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-10-26 23:09:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-10-26 23:09:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-10-26 23:09:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-10-26 23:09:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-10-26 23:09:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-10-26 23:09:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-10-26 23:09:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-10-26 23:09:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-10-26 23:09:56 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-10-26 23:09:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-10-26 23:09:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-10-26 23:09:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-10-26 23:09:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-10-26 23:09:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-10-26 23:09:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-10-26 23:09:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-10-26 23:09:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-10-26 23:09:57 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-10-26 23:09:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-10-26 23:09:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-10-26 23:09:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-10-26 23:09:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-10-26 23:09:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-10-26 23:09:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-10-26 23:09:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-10-26 23:09:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-10-26 23:09:58 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-10-26 23:09:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-10-26 23:09:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-10-26 23:09:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-10-26 23:09:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-10-26 23:09:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-10-26 23:09:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-10-26 23:09:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-10-26 23:09:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-10-26 23:09:59 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-10-26 23:09:59 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-10-26 23:10:00 [INFO    ] Setting Beam 2 xbars
2018-10-26 23:10:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-10-26 23:10:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-10-26 23:10:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-10-26 23:10:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-10-26 23:10:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-10-26 23:10:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-10-26 23:10:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-10-26 23:10:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-10-26 23:10:00 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-10-26 23:10:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-10-26 23:10:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-10-26 23:10:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-10-26 23:10:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-10-26 23:10:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-10-26 23:10:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-10-26 23:10:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-10-26 23:10:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-10-26 23:10:01 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-10-26 23:10:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-10-26 23:10:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-10-26 23:10:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-10-26 23:10:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-10-26 23:10:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-10-26 23:10:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-10-26 23:10:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-10-26 23:10:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-10-26 23:10:02 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-10-26 23:10:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-10-26 23:10:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-10-26 23:10:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-10-26 23:10:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-10-26 23:10:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-10-26 23:10:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-10-26 23:10:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-10-26 23:10:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-10-26 23:10:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-10-26 23:10:03 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-10-26 23:10:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-10-26 23:10:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-10-26 23:10:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-10-26 23:10:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-10-26 23:10:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-10-26 23:10:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-10-26 23:10:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-10-26 23:10:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-10-26 23:10:04 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-10-26 23:10:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-10-26 23:10:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-10-26 23:10:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-10-26 23:10:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-10-26 23:10:05 [INFO    ] Setting Beam 3 xbars
2018-10-26 23:10:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-10-26 23:10:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-10-26 23:10:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-10-26 23:10:05 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-10-26 23:10:05 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-10-26 23:10:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-10-26 23:10:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-10-26 23:10:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-10-26 23:10:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-10-26 23:10:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-10-26 23:10:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-10-26 23:10:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-10-26 23:10:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-10-26 23:10:06 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-10-26 23:10:06 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-10-26 23:10:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-10-26 23:10:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-10-26 23:10:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-10-26 23:10:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-10-26 23:10:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-10-26 23:10:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-10-26 23:10:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-10-26 23:10:07 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-10-26 23:10:07 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-10-26 23:10:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-10-26 23:10:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-10-26 23:10:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-10-26 23:10:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-10-26 23:10:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-10-26 23:10:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-10-26 23:10:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-10-26 23:10:08 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-10-26 23:10:08 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-10-26 23:10:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-10-26 23:10:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-10-26 23:10:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-10-26 23:10:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-10-26 23:10:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-10-26 23:10:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-10-26 23:10:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-10-26 23:10:09 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-10-26 23:10:09 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-10-26 23:10:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-10-26 23:10:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-10-26 23:10:11 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-10-26 23:10:11 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-10-26 23:10:11 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-10-26 23:10:11 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-10-26 23:10:11 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-10-26 23:10:11 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-10-26 23:10:11 [INFO    ] Setting Beam 4 xbars
2018-10-26 23:10:11 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-10-26 23:10:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-26 23:10:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-26 23:10:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-26 23:10:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-26 23:10:12 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-10-26 23:10:12 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-10-26 23:10:12 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-10-26 23:10:12 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-10-26 23:10:12 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-10-26 23:10:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-10-26 23:10:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-10-26 23:10:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-10-26 23:10:13 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-10-26 23:10:13 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-10-26 23:10:13 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-10-26 23:10:13 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-10-26 23:10:13 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-10-26 23:10:13 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-10-26 23:10:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-10-26 23:10:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-10-26 23:10:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-10-26 23:10:14 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-10-26 23:10:14 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-10-26 23:10:14 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-10-26 23:10:14 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-10-26 23:10:14 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-10-26 23:10:14 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-10-26 23:10:14 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-10-26 23:10:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-10-26 23:10:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-10-26 23:10:15 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-10-26 23:10:15 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-10-26 23:10:15 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-10-26 23:10:15 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-10-26 23:10:15 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-10-26 23:10:15 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-10-26 23:10:15 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-10-26 23:10:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-10-26 23:10:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-10-26 23:10:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-10-26 23:10:16 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-10-26 23:10:16 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-10-26 23:10:16 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-10-26 23:10:16 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-10-26 23:10:16 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-10-26 23:10:16 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-10-26 23:10:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-10-26 23:10:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-10-26 23:10:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-10-26 23:10:17 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-10-26 23:10:17 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-10-26 23:10:17 [INFO    ] All xbars set
2018-10-26 23:10:17 [INFO    ] Setting adder chain routing for all beams
2018-10-26 23:10:21 [INFO    ] Setting beam ids
2018-10-26 23:10:32 [INFO    ] Starting beam delay calibration
2018-10-26 23:10:37 [DEBUG   ] Got command RPT from MCS: ref #281705
2018-10-26 23:10:37 [DEBUG   ] summary = BOOTING
2018-10-26 23:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281705  15 58417 83437545 ABOOTINGBOOTING'
2018-10-26 23:10:37 [DEBUG   ] Got command RPT from MCS: ref #281706
2018-10-26 23:10:37 [DEBUG   ] info = Starting calibration
2018-10-26 23:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281706  28 58417 83437546 ABOOTINGStarting calibration'
2018-10-26 23:10:44 [INFO    ] Beam 1 latency is 6705
2018-10-26 23:10:44 [INFO    ] Beam 2 latency is 5702
2018-10-26 23:10:44 [INFO    ] Beam 3 latency is 5712
2018-10-26 23:10:44 [INFO    ] Beam 4 latency is 6673
2018-10-26 23:10:44 [INFO    ] Stop calibration
2018-10-26 23:10:52 [ERROR   ] Beam delay calibration failed
2018-10-26 23:10:52 [CRITICAL] Calibration failed
2018-10-26 23:10:52 [DEBUG   ] spawn_process: at 2018-10-26 23:10:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-10-26 23:10:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-10-26 23:10:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-10-26 23:10:52 [DEBUG   ] spawn_process: at 2018-10-26 23:10:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-10-26 23:10:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-10-26 23:10:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-10-26 23:10:52 [DEBUG   ] spawn_process: at 2018-10-26 23:10:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-10-26 23:10:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-10-26 23:10:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-10-26 23:10:53 [DEBUG   ] spawn_process: at 2018-10-26 23:10:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-10-26 23:10:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-10-26 23:10:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-10-26 23:10:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-10-26 23:10:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 271 ms (1540595453.273 s) with PID 32128 and time 1540595454
2018-10-26 23:10:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-10-26 23:10:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 360 ms (1540595453.361 s) with PID 32131 and time 1540595454
2018-10-26 23:10:54 [DEBUG   ] Finished updating ant stats in 0.886 seconds
2018-10-26 23:10:54 [INFO    ] Started antennas statistics background thread
2018-10-26 23:10:54 [INFO    ] Started board flags background thread
2018-10-26 23:10:54 [INFO    ] Started BAM background thread
2018-10-26 23:10:54 [INFO    ] Finished the INI process (ref. #281704) in 108.688 s
2018-10-26 23:10:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 23:10:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:10:55 [WARNING ] (13, 1, 'bot')
2018-10-26 23:10:55 [WARNING ] (13, 1, 'bot')
2018-10-26 23:10:55 [WARNING ] (13, 1, 'bot')
2018-10-26 23:10:55 [WARNING ] (13, 1, 'bot')
2018-10-26 23:10:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-10-26 23:10:55 [DEBUG   ] Finished updating board flags in 1.066 seconds
2018-10-26 23:11:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 23:11:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 23:11:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 23:11:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:11:55 [WARNING ] (13, 1, 'bot')
2018-10-26 23:11:55 [WARNING ] (13, 1, 'bot')
2018-10-26 23:11:55 [WARNING ] (13, 1, 'bot')
2018-10-26 23:11:55 [WARNING ] (13, 1, 'bot')
2018-10-26 23:11:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-10-26 23:11:55 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-10-26 23:12:05 [DEBUG   ] Got command RPT from MCS: ref #281726
2018-10-26 23:12:05 [DEBUG   ] summary = ERROR
2018-10-26 23:12:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281726  13 58417 83525793 A  ERRORERROR'
2018-10-26 23:12:05 [DEBUG   ] Got command RPT from MCS: ref #281727
2018-10-26 23:12:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:12:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281727  98 58417 83525794 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:12:10 [DEBUG   ] Got command INI from MCS: ref #281728
2018-10-26 23:12:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-10-26 23:12:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   281728   8 58417 83530802 ABOOTING'
2018-10-26 23:12:14 [DEBUG   ] Finished updating ant stats in 0.825 seconds
2018-10-26 23:12:31 [INFO    ] -------------------
2018-10-26 23:12:31 [INFO    ]  LWA board status
2018-10-26 23:12:31 [INFO    ] -------------------
2018-10-26 23:12:31 [INFO    ] DP 1: 2 lwa27
2018-10-26 23:12:31 [INFO    ] DP 1: 3 lwa24
2018-10-26 23:12:31 [INFO    ] DP 1: 4 lwa23
2018-10-26 23:12:31 [INFO    ] DP 1: 5 lwa18
2018-10-26 23:12:31 [INFO    ] DP 1: 6 lwa10
2018-10-26 23:12:31 [INFO    ] DP 1: 7 lwa32
2018-10-26 23:12:31 [INFO    ] DP 1: 8 lwa11
2018-10-26 23:12:31 [INFO    ] DP 1: 9 lwa30
2018-10-26 23:12:31 [INFO    ] DP 1: 10 lwa12
2018-10-26 23:12:31 [INFO    ] DP 1: 11 lwa8
2018-10-26 23:12:31 [INFO    ] DP 1: 12 lwa13
2018-10-26 23:12:31 [INFO    ] DP 1: 13 lwa26
2018-10-26 23:12:31 [INFO    ] DP 1: 14 lwa14
2018-10-26 23:12:31 [INFO    ] DP 1: 16 lwa22
2018-10-26 23:12:31 [INFO    ] DP 1: 17 lwa20
2018-10-26 23:12:31 [INFO    ] DP 1: 18 lwa1
2018-10-26 23:12:31 [INFO    ] DP 1: 19 lwa5
2018-10-26 23:12:31 [INFO    ] DP 1: 20 lwa25
2018-10-26 23:12:31 [INFO    ] DP 1: 21 lwa35
2018-10-26 23:12:31 [INFO    ] DP 1: 22 lwa19
2018-10-26 23:12:31 [INFO    ] DP 1: 23 lwa21
2018-10-26 23:12:31 [INFO    ] DP 1: 24 lwa6
2018-10-26 23:12:31 [INFO    ] DP 1: 25 lwa7
2018-10-26 23:12:31 [INFO    ] DP 1: 26 lwa33
2018-10-26 23:12:31 [INFO    ] DP 1: 27 lwa15
2018-10-26 23:12:31 [INFO    ] DP 1: 28 lwa28
2018-10-26 23:12:31 [INFO    ] DP 2: 1 lwa16
2018-10-26 23:12:31 [INFO    ] DP 2: 15 lwa34
2018-10-26 23:12:31 [INFO    ] Total of 28 boards
2018-10-26 23:12:31 [INFO    ] Total of 260 stands
2018-10-26 23:12:31 [INFO    ] -------------------
2018-10-26 23:12:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32682
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32683
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32684
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32685
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32686
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32687
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32688
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32689
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32690
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32691
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32692
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32693
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32694
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32695
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32696
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32697
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32698
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32699
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32700
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32701
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32702
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32703
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32704
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32705
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32706
2018-10-26 23:12:38 [DEBUG   ] 2018-10-26 23:12:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32707
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32682 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32683 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32684 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32685 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32686 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32687 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32688 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32689 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32690 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32691 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32692 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32693 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32694 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32695 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32696 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32697 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32698 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32699 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32700 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32701 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32702 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32703 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32704 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32705 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32706 exited with status 0
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32707 exited with status 0
2018-10-26 23:12:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] spawn_process: at 2018-10-26 23:12:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 32734
2018-10-26 23:12:50 [DEBUG   ] 2018-10-26 23:12:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 32735
2018-10-26 23:12:56 [DEBUG   ] 2018-10-26 23:12:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 32734 exited with status 0
2018-10-26 23:12:56 [DEBUG   ] 2018-10-26 23:12:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 32735 exited with status 0
2018-10-26 23:12:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-10-26 23:12:56 [DEBUG   ] spawn_process: at 2018-10-26 23:12:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-10-26 23:12:56 [DEBUG   ] spawn_process: at 2018-10-26 23:12:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-10-26 23:12:56 [INFO    ] Setting Beam 1 xbars
2018-10-26 23:12:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-10-26 23:12:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-10-26 23:12:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-10-26 23:12:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-10-26 23:12:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-10-26 23:12:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-10-26 23:12:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-10-26 23:12:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-10-26 23:12:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-10-26 23:12:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-10-26 23:12:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-10-26 23:12:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-10-26 23:12:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-10-26 23:12:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-10-26 23:12:58 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-10-26 23:12:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-10-26 23:12:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-10-26 23:12:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-10-26 23:12:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-10-26 23:12:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-10-26 23:12:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-10-26 23:12:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-10-26 23:12:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-10-26 23:12:59 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-10-26 23:12:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-10-26 23:12:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-10-26 23:12:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-10-26 23:12:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-10-26 23:12:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-10-26 23:12:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-10-26 23:12:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-10-26 23:12:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-10-26 23:13:00 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-10-26 23:13:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-10-26 23:13:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-10-26 23:13:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-10-26 23:13:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-10-26 23:13:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-10-26 23:13:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-10-26 23:13:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-10-26 23:13:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-10-26 23:13:00 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-10-26 23:13:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-10-26 23:13:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-10-26 23:13:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-10-26 23:13:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-10-26 23:13:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-10-26 23:13:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-10-26 23:13:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-10-26 23:13:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-10-26 23:13:01 [INFO    ] Setting Beam 2 xbars
2018-10-26 23:13:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-10-26 23:13:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-10-26 23:13:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-10-26 23:13:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-10-26 23:13:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-10-26 23:13:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-10-26 23:13:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-10-26 23:13:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-10-26 23:13:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-10-26 23:13:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-10-26 23:13:03 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-10-26 23:13:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-10-26 23:13:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-10-26 23:13:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-10-26 23:13:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-10-26 23:13:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-10-26 23:13:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-10-26 23:13:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-10-26 23:13:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-10-26 23:13:04 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-10-26 23:13:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-10-26 23:13:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-10-26 23:13:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-10-26 23:13:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-10-26 23:13:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-10-26 23:13:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-10-26 23:13:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-10-26 23:13:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-10-26 23:13:04 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-10-26 23:13:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-10-26 23:13:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-10-26 23:13:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-10-26 23:13:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-10-26 23:13:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-10-26 23:13:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-10-26 23:13:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-10-26 23:13:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-10-26 23:13:05 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-10-26 23:13:06 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-10-26 23:13:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-10-26 23:13:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-10-26 23:13:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-10-26 23:13:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-10-26 23:13:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-10-26 23:13:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-10-26 23:13:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-10-26 23:13:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-10-26 23:13:07 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-10-26 23:13:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-10-26 23:13:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-10-26 23:13:07 [INFO    ] Setting Beam 3 xbars
2018-10-26 23:13:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-10-26 23:13:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-10-26 23:13:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-10-26 23:13:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-10-26 23:13:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-10-26 23:13:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-10-26 23:13:08 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-10-26 23:13:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-10-26 23:13:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-10-26 23:13:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-10-26 23:13:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-10-26 23:13:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-10-26 23:13:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-10-26 23:13:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-10-26 23:13:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-10-26 23:13:09 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-10-26 23:13:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-10-26 23:13:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-10-26 23:13:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-10-26 23:13:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-10-26 23:13:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-10-26 23:13:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-10-26 23:13:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-10-26 23:13:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-10-26 23:13:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-10-26 23:13:10 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-10-26 23:13:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-10-26 23:13:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-10-26 23:13:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-10-26 23:13:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-10-26 23:13:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-10-26 23:13:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-10-26 23:13:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-10-26 23:13:11 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-10-26 23:13:11 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-10-26 23:13:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-10-26 23:13:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-10-26 23:13:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-10-26 23:13:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-10-26 23:13:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-10-26 23:13:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-10-26 23:13:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-10-26 23:13:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-10-26 23:13:12 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-10-26 23:13:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-10-26 23:13:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-10-26 23:13:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-10-26 23:13:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-10-26 23:13:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-10-26 23:13:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-10-26 23:13:12 [INFO    ] Setting Beam 4 xbars
2018-10-26 23:13:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-10-26 23:13:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-26 23:13:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-26 23:13:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-26 23:13:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-26 23:13:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-10-26 23:13:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-10-26 23:13:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-10-26 23:13:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-10-26 23:13:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-10-26 23:13:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-10-26 23:13:14 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-10-26 23:13:14 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-10-26 23:13:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-10-26 23:13:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-10-26 23:13:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-10-26 23:13:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-10-26 23:13:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-10-26 23:13:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-10-26 23:13:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-10-26 23:13:15 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-10-26 23:13:15 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-10-26 23:13:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-10-26 23:13:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-10-26 23:13:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-10-26 23:13:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-10-26 23:13:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-10-26 23:13:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-10-26 23:13:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-10-26 23:13:16 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-10-26 23:13:16 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-10-26 23:13:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-10-26 23:13:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-10-26 23:13:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-10-26 23:13:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-10-26 23:13:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-10-26 23:13:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-10-26 23:13:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-10-26 23:13:17 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-10-26 23:13:17 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-10-26 23:13:17 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-10-26 23:13:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-10-26 23:13:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-10-26 23:13:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-10-26 23:13:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-10-26 23:13:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-10-26 23:13:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-10-26 23:13:18 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-10-26 23:13:18 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-10-26 23:13:18 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-10-26 23:13:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-10-26 23:13:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-10-26 23:13:18 [INFO    ] All xbars set
2018-10-26 23:13:18 [INFO    ] Setting adder chain routing for all beams
2018-10-26 23:13:23 [INFO    ] Setting beam ids
2018-10-26 23:13:33 [INFO    ] Starting beam delay calibration
2018-10-26 23:13:45 [DEBUG   ] Got command RPT from MCS: ref #281731
2018-10-26 23:13:45 [DEBUG   ] summary = BOOTING
2018-10-26 23:13:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281731  15 58417 83625113 ABOOTINGBOOTING'
2018-10-26 23:13:45 [INFO    ] Beam 1 latency is 5729
2018-10-26 23:13:45 [INFO    ] Beam 2 latency is 5713
2018-10-26 23:13:45 [INFO    ] Beam 3 latency is 5726
2018-10-26 23:13:45 [INFO    ] Beam 4 latency is 5718
2018-10-26 23:13:45 [INFO    ] Stop calibration
2018-10-26 23:13:53 [INFO    ] Beam delay calibration successful
2018-10-26 23:13:53 [INFO    ] Calibration passed
2018-10-26 23:13:53 [DEBUG   ] spawn_process: at 2018-10-26 23:13:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-10-26 23:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-10-26 23:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-10-26 23:13:53 [DEBUG   ] spawn_process: at 2018-10-26 23:13:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-10-26 23:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-10-26 23:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-10-26 23:13:53 [DEBUG   ] spawn_process: at 2018-10-26 23:13:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-10-26 23:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-10-26 23:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-10-26 23:13:53 [DEBUG   ] spawn_process: at 2018-10-26 23:13:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-10-26 23:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-10-26 23:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-10-26 23:13:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-10-26 23:13:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 298 ms (1540595634.299 s) with PID 1858 and time 1540595635
2018-10-26 23:13:54 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-10-26 23:13:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 388 ms (1540595634.389 s) with PID 1861 and time 1540595635
2018-10-26 23:13:55 [DEBUG   ] Finished updating ant stats in 0.858 seconds
2018-10-26 23:13:55 [INFO    ] Started antennas statistics background thread
2018-10-26 23:13:55 [INFO    ] Started board flags background thread
2018-10-26 23:13:55 [INFO    ] Started BAM background thread
2018-10-26 23:13:55 [INFO    ] Finished the INI process (ref. #281728) in 104.709 s
2018-10-26 23:13:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-26 23:13:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:13:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 23:13:56 [WARNING ] (13, 1, 'bot')
2018-10-26 23:13:56 [WARNING ] (13, 1, 'bot')
2018-10-26 23:13:56 [WARNING ] (13, 1, 'bot')
2018-10-26 23:13:56 [WARNING ] (13, 1, 'bot')
2018-10-26 23:13:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:13:56 [DEBUG   ] Finished updating board flags in 1.043 seconds
2018-10-26 23:14:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 23:14:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 23:14:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 23:14:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:14:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-26 23:14:56 [WARNING ] (13, 1, 'bot')
2018-10-26 23:14:56 [WARNING ] (13, 1, 'bot')
2018-10-26 23:14:56 [WARNING ] (13, 1, 'bot')
2018-10-26 23:14:56 [WARNING ] (13, 1, 'bot')
2018-10-26 23:14:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:14:56 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-10-26 23:15:10 [DEBUG   ] Got command RPT from MCS: ref #281741
2018-10-26 23:15:10 [DEBUG   ] summary = ERROR
2018-10-26 23:15:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281741  13 58417 83710797 A  ERRORERROR'
2018-10-26 23:15:10 [DEBUG   ] Got command RPT from MCS: ref #281742
2018-10-26 23:15:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:15:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281742  77 58417 83710798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:15:15 [DEBUG   ] Finished updating ant stats in 0.790 seconds
2018-10-26 23:15:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 23:15:37 [DEBUG   ] Got command RPT from MCS: ref #281743
2018-10-26 23:15:37 [DEBUG   ] summary = ERROR
2018-10-26 23:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281743  13 58417 83737541 A  ERRORERROR'
2018-10-26 23:15:37 [DEBUG   ] Got command RPT from MCS: ref #281744
2018-10-26 23:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281744  77 58417 83737542 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:15:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 23:15:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:15:56 [WARNING ] (13, 1, 'bot')
2018-10-26 23:15:56 [WARNING ] (13, 1, 'bot')
2018-10-26 23:15:56 [WARNING ] (13, 1, 'bot')
2018-10-26 23:15:56 [WARNING ] (13, 1, 'bot')
2018-10-26 23:15:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:15:56 [DEBUG   ] Finished updating board flags in 0.986 seconds
2018-10-26 23:16:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 23:16:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 23:16:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 23:16:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 23:16:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:16:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:16:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:16:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:16:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:16:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:16:57 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-10-26 23:17:15 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-26 23:17:35 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-26 23:17:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 23:17:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:17:56 [WARNING ] (13, 1, 'bot')
2018-10-26 23:17:56 [WARNING ] (13, 1, 'bot')
2018-10-26 23:17:56 [WARNING ] (13, 1, 'bot')
2018-10-26 23:17:56 [WARNING ] (13, 1, 'bot')
2018-10-26 23:17:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:17:56 [DEBUG   ] Finished updating board flags in 1.236 seconds
2018-10-26 23:18:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 23:18:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 23:18:45 [DEBUG   ] Got command RPT from MCS: ref #281764
2018-10-26 23:18:45 [DEBUG   ] summary = ERROR
2018-10-26 23:18:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281764  13 58417 83925197 A  ERRORERROR'
2018-10-26 23:18:45 [DEBUG   ] Got command RPT from MCS: ref #281765
2018-10-26 23:18:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:18:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281765  77 58417 83925401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:18:45 [DEBUG   ] Got command RPT from MCS: ref #281766
2018-10-26 23:18:45 [DEBUG   ] summary = ERROR
2018-10-26 23:18:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281766  13 58417 83925605 A  ERRORERROR'
2018-10-26 23:18:45 [DEBUG   ] Got command RPT from MCS: ref #281767
2018-10-26 23:18:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:18:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281767  77 58417 83925797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:18:46 [DEBUG   ] Got command RPT from MCS: ref #281768
2018-10-26 23:18:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 23:18:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281768  12 58417 83926001 A  ERRORB›™š'
2018-10-26 23:18:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 23:18:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-26 23:18:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:18:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:18:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:18:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:18:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:18:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:18:57 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-26 23:19:15 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2018-10-26 23:19:36 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-26 23:19:56 [DEBUG   ] Finished updating ant stats in 1.033 seconds
2018-10-26 23:19:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:19:57 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 23:19:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:19:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:19:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:19:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:19:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:19:57 [DEBUG   ] Finished updating board flags in 1.574 seconds
2018-10-26 23:20:16 [DEBUG   ] Finished updating ant stats in 0.970 seconds
2018-10-26 23:20:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 23:20:37 [DEBUG   ] Got command RPT from MCS: ref #281773
2018-10-26 23:20:37 [DEBUG   ] summary = ERROR
2018-10-26 23:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281773  13 58417 84037549 A  ERRORERROR'
2018-10-26 23:20:37 [DEBUG   ] Got command RPT from MCS: ref #281774
2018-10-26 23:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281774  77 58417 84037550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:20:56 [DEBUG   ] Finished updating ant stats in 0.831 seconds
2018-10-26 23:20:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:20:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:20:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:20:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:20:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:20:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:20:57 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-26 23:21:16 [DEBUG   ] Finished updating ant stats in 0.773 seconds
2018-10-26 23:21:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 23:21:56 [DEBUG   ] Finished updating ant stats in 0.632 seconds
2018-10-26 23:21:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:21:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:21:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:21:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:21:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:21:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:21:57 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-10-26 23:22:16 [DEBUG   ] Finished updating ant stats in 0.570 seconds
2018-10-26 23:22:36 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-26 23:22:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 23:22:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:22:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:22:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:22:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:22:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:22:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:22:57 [DEBUG   ] Finished updating board flags in 1.222 seconds
2018-10-26 23:23:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 23:23:36 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2018-10-26 23:23:45 [DEBUG   ] Got command RPT from MCS: ref #281796
2018-10-26 23:23:45 [DEBUG   ] summary = ERROR
2018-10-26 23:23:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281796  13 58417 84225285 A  ERRORERROR'
2018-10-26 23:23:45 [DEBUG   ] Got command RPT from MCS: ref #281797
2018-10-26 23:23:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:23:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281797  77 58417 84225489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:23:45 [DEBUG   ] Got command RPT from MCS: ref #281798
2018-10-26 23:23:45 [DEBUG   ] summary = ERROR
2018-10-26 23:23:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281798  13 58417 84225681 A  ERRORERROR'
2018-10-26 23:23:45 [DEBUG   ] Got command RPT from MCS: ref #281800
2018-10-26 23:23:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:23:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281800  77 58417 84225885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:23:46 [DEBUG   ] Got command RPT from MCS: ref #281801
2018-10-26 23:23:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 23:23:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281801  12 58417 84226089 A  ERRORB›™š'
2018-10-26 23:23:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:23:57 [DEBUG   ] Finished updating ant stats in 1.229 seconds
2018-10-26 23:23:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:23:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:23:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:23:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:23:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:23:57 [DEBUG   ] Finished updating board flags in 1.255 seconds
2018-10-26 23:24:17 [DEBUG   ] Finished updating ant stats in 1.174 seconds
2018-10-26 23:24:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 23:24:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 23:24:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:24:57 [DEBUG   ] Finished updating ant stats in 1.029 seconds
2018-10-26 23:24:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:24:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:24:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:24:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:24:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:24:57 [DEBUG   ] Finished updating board flags in 1.214 seconds
2018-10-26 23:25:17 [DEBUG   ] Finished updating ant stats in 0.973 seconds
2018-10-26 23:25:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 23:25:37 [DEBUG   ] Got command RPT from MCS: ref #281806
2018-10-26 23:25:37 [DEBUG   ] summary = ERROR
2018-10-26 23:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281806  13 58417 84337549 A  ERRORERROR'
2018-10-26 23:25:37 [DEBUG   ] Got command RPT from MCS: ref #281807
2018-10-26 23:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281807  77 58417 84337550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:25:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 23:25:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:25:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:25:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:25:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:25:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:25:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:25:58 [DEBUG   ] Finished updating board flags in 2.136 seconds
2018-10-26 23:26:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 23:26:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 23:26:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:26:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-26 23:26:57 [DEBUG   ] Finished updating ant stats in 0.833 seconds
2018-10-26 23:26:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:26:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:26:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:26:57 [WARNING ] (13, 1, 'bot')
2018-10-26 23:26:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:26:57 [DEBUG   ] Finished updating board flags in 1.098 seconds
2018-10-26 23:27:17 [DEBUG   ] Finished updating ant stats in 0.770 seconds
2018-10-26 23:27:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 23:27:57 [DEBUG   ] Finished updating ant stats in 0.632 seconds
2018-10-26 23:27:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:27:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 23:27:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:27:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:27:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:27:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:27:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:27:58 [DEBUG   ] Finished updating board flags in 1.957 seconds
2018-10-26 23:28:17 [DEBUG   ] Finished updating ant stats in 0.570 seconds
2018-10-26 23:28:37 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-26 23:28:45 [DEBUG   ] Got command RPT from MCS: ref #281827
2018-10-26 23:28:45 [DEBUG   ] summary = ERROR
2018-10-26 23:28:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281827  13 58417 84525377 A  ERRORERROR'
2018-10-26 23:28:45 [DEBUG   ] Got command RPT from MCS: ref #281828
2018-10-26 23:28:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:28:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281828  77 58417 84525569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:28:45 [DEBUG   ] Got command RPT from MCS: ref #281829
2018-10-26 23:28:45 [DEBUG   ] summary = ERROR
2018-10-26 23:28:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281829  13 58417 84525773 A  ERRORERROR'
2018-10-26 23:28:45 [DEBUG   ] Got command RPT from MCS: ref #281830
2018-10-26 23:28:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:28:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281830  77 58417 84525977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:28:46 [DEBUG   ] Got command RPT from MCS: ref #281831
2018-10-26 23:28:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 23:28:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281831  12 58417 84526181 A  ERRORB›™š'
2018-10-26 23:28:57 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2018-10-26 23:28:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:28:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:28:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:28:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:28:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:28:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:28:58 [DEBUG   ] Finished updating board flags in 1.761 seconds
2018-10-26 23:29:17 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-10-26 23:29:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 23:29:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-26 23:29:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:29:58 [DEBUG   ] Got command DRX from MCS: ref #281841
2018-10-26 23:29:58 [INFO    ] sending drx command to lwa34
2018-10-26 23:29:58 [DEBUG   ] run_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 68000000.0 6 9 0']
2018-10-26 23:29:58 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-26 23:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   281841   8 58417 84598005 A  ERROR'
2018-10-26 23:29:58 [DEBUG   ] Got command DRX from MCS: ref #281840
2018-10-26 23:29:58 [INFO    ] sending drx command to lwa16
2018-10-26 23:29:58 [DEBUG   ] run_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 68000000.0 6 9 0']
2018-10-26 23:29:58 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-26 23:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   281840   8 58417 84598009 A  ERROR'
2018-10-26 23:29:58 [DEBUG   ] Got command DRX from MCS: ref #281842
2018-10-26 23:29:58 [INFO    ] sending drx command to lwa16
2018-10-26 23:29:58 [DEBUG   ] run_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 78000000.0 6 9 0']
2018-10-26 23:29:58 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-26 23:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   281842   8 58417 84598013 A  ERROR'
2018-10-26 23:29:58 [DEBUG   ] Got command DRX from MCS: ref #281843
2018-10-26 23:29:58 [INFO    ] sending drx command to lwa34
2018-10-26 23:29:58 [DEBUG   ] run_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 78000000.0 6 9 0']
2018-10-26 23:29:58 [DEBUG   ] drx = exited with status True, code 0x00
2018-10-26 23:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   281843   8 58417 84598017 A  ERROR'
2018-10-26 23:29:58 [DEBUG   ] Got command BAM from MCS: ref #281844
2018-10-26 23:29:58 [INFO    ] Finished processing BAM request
2018-10-26 23:29:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281844   8 58417 84598033 A  ERROR'
2018-10-26 23:29:58 [DEBUG   ] Got command BAM from MCS: ref #281845
2018-10-26 23:29:58 [INFO    ] Finished processing BAM request
2018-10-26 23:29:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281845   8 58417 84598037 A  ERROR'
2018-10-26 23:29:58 [INFO    ] Finished starting DRX
2018-10-26 23:29:58 [INFO    ] Finished starting DRX
2018-10-26 23:29:58 [INFO    ] Finished starting DRX
2018-10-26 23:29:58 [INFO    ] Finished starting DRX
2018-10-26 23:29:58 [DEBUG   ] Finished updating ant stats in 1.228 seconds
2018-10-26 23:29:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:29:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:29:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:29:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:29:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:29:58 [DEBUG   ] Finished updating board flags in 1.662 seconds
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 23:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 23:29:58 [DEBUG   ] spawn_process: at 2018-10-26 23:29:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 23:30:18 [DEBUG   ] Finished updating ant stats in 1.174 seconds
2018-10-26 23:30:37 [DEBUG   ] Got command RPT from MCS: ref #281848
2018-10-26 23:30:37 [DEBUG   ] summary = ERROR
2018-10-26 23:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281848  13 58417 84637549 A  ERRORERROR'
2018-10-26 23:30:37 [DEBUG   ] Got command RPT from MCS: ref #281849
2018-10-26 23:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281849  77 58417 84637550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:30:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 23:30:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-26 23:30:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:30:58 [DEBUG   ] Finished updating ant stats in 1.027 seconds
2018-10-26 23:30:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-10-26 23:30:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:30:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:30:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:30:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:30:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:30:58 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-10-26 23:31:07 [DEBUG   ] Got command BAM from MCS: ref #281865
2018-10-26 23:31:07 [INFO    ] Finished processing BAM request
2018-10-26 23:31:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:31:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281865   8 58417 84667029 A  ERROR'
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 23:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 23:31:07 [DEBUG   ] spawn_process: at 2018-10-26 23:31:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 23:31:14 [DEBUG   ] Got command BAM from MCS: ref #281866
2018-10-26 23:31:14 [INFO    ] Finished processing BAM request
2018-10-26 23:31:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:31:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281866   8 58417 84674029 A  ERROR'
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 23:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 23:31:14 [DEBUG   ] spawn_process: at 2018-10-26 23:31:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 23:31:18 [DEBUG   ] Finished updating ant stats in 0.978 seconds
2018-10-26 23:31:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 23:31:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 23:31:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-26 23:31:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-26 23:31:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:31:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-26 23:31:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-26 23:31:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:31:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:31:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:31:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:31:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:31:58 [DEBUG   ] Finished updating board flags in 1.665 seconds
2018-10-26 23:32:15 [DEBUG   ] Got command BAM from MCS: ref #281871
2018-10-26 23:32:15 [INFO    ] Finished processing BAM request
2018-10-26 23:32:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:32:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281871   8 58417 84735029 A  ERROR'
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 23:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 23:32:15 [DEBUG   ] spawn_process: at 2018-10-26 23:32:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 23:32:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 23:32:29 [DEBUG   ] Got command BAM from MCS: ref #281872
2018-10-26 23:32:29 [INFO    ] Finished processing BAM request
2018-10-26 23:32:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:32:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281872   8 58417 84749037 A  ERROR'
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 23:32:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 23:32:29 [DEBUG   ] spawn_process: at 2018-10-26 23:32:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 23:32:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 23:32:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-26 23:32:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-26 23:32:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 23:32:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-26 23:32:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:32:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 23:32:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 23:32:58 [DEBUG   ] Finished updating ant stats in 0.823 seconds
2018-10-26 23:32:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-26 23:32:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:32:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:32:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:32:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:32:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:32:58 [DEBUG   ] Finished updating board flags in 1.335 seconds
2018-10-26 23:33:18 [DEBUG   ] Finished updating ant stats in 0.778 seconds
2018-10-26 23:33:22 [DEBUG   ] Got command BAM from MCS: ref #281873
2018-10-26 23:33:22 [INFO    ] Finished processing BAM request
2018-10-26 23:33:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281873   8 58417 84802029 A  ERROR'
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 23:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 23:33:22 [DEBUG   ] spawn_process: at 2018-10-26 23:33:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 23:33:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 23:33:43 [DEBUG   ] Got command BAM from MCS: ref #281876
2018-10-26 23:33:43 [INFO    ] Finished processing BAM request
2018-10-26 23:33:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:33:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281876   8 58417 84823025 A  ERROR'
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 23:33:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 23:33:43 [DEBUG   ] spawn_process: at 2018-10-26 23:33:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 23:33:45 [DEBUG   ] Got command RPT from MCS: ref #281877
2018-10-26 23:33:45 [DEBUG   ] summary = ERROR
2018-10-26 23:33:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281877  13 58417 84825461 A  ERRORERROR'
2018-10-26 23:33:45 [DEBUG   ] Got command RPT from MCS: ref #281878
2018-10-26 23:33:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:33:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281878  77 58417 84825653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:33:45 [DEBUG   ] Got command RPT from MCS: ref #281879
2018-10-26 23:33:45 [DEBUG   ] summary = ERROR
2018-10-26 23:33:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281879  13 58417 84825857 A  ERRORERROR'
2018-10-26 23:33:46 [DEBUG   ] Got command RPT from MCS: ref #281881
2018-10-26 23:33:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:33:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281881  77 58417 84826061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:33:46 [DEBUG   ] Got command RPT from MCS: ref #281882
2018-10-26 23:33:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 23:33:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281882  12 58417 84826265 A  ERRORB£ff'
2018-10-26 23:33:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 23:33:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:33:58 [DEBUG   ] Finished updating ant stats in 0.628 seconds
2018-10-26 23:33:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-26 23:33:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-26 23:33:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:33:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:33:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:33:58 [WARNING ] (13, 1, 'bot')
2018-10-26 23:33:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:33:58 [DEBUG   ] Finished updating board flags in 1.195 seconds
2018-10-26 23:34:18 [DEBUG   ] Finished updating ant stats in 0.573 seconds
2018-10-26 23:34:28 [DEBUG   ] Got command BAM from MCS: ref #281887
2018-10-26 23:34:28 [INFO    ] Finished processing BAM request
2018-10-26 23:34:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:34:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281887   8 58417 84868025 A  ERROR'
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 23:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 23:34:28 [DEBUG   ] spawn_process: at 2018-10-26 23:34:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 23:34:38 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-26 23:34:55 [DEBUG   ] Got command BAM from MCS: ref #281888
2018-10-26 23:34:55 [INFO    ] Finished processing BAM request
2018-10-26 23:34:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:34:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281888   8 58417 84895029 A  ERROR'
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 23:34:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 23:34:55 [DEBUG   ] spawn_process: at 2018-10-26 23:34:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 23:34:58 [DEBUG   ] Got command BAM from MCS: ref #281890
2018-10-26 23:34:58 [INFO    ] Finished processing BAM request
2018-10-26 23:34:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281890   8 58417 84898033 A  ERROR'
2018-10-26 23:34:58 [DEBUG   ] Got command BAM from MCS: ref #281889
2018-10-26 23:34:58 [INFO    ] Finished processing BAM request
2018-10-26 23:34:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281889   8 58417 84898037 A  ERROR'
2018-10-26 23:34:58 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2018-10-26 23:34:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-26 23:34:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 23:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 23:34:58 [DEBUG   ] spawn_process: at 2018-10-26 23:34:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 23:34:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-26 23:34:59 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-26 23:34:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-26 23:34:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 23:34:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:34:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:34:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:34:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:34:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:34:59 [DEBUG   ] Finished updating board flags in 1.955 seconds
2018-10-26 23:35:18 [DEBUG   ] Finished updating ant stats in 0.373 seconds
2018-10-26 23:35:37 [DEBUG   ] Got command RPT from MCS: ref #281897
2018-10-26 23:35:37 [DEBUG   ] summary = ERROR
2018-10-26 23:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281897  13 58417 84937549 A  ERRORERROR'
2018-10-26 23:35:37 [DEBUG   ] Got command RPT from MCS: ref #281898
2018-10-26 23:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281898  77 58417 84937550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:35:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 23:35:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 23:35:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 23:35:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:35:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-26 23:35:59 [DEBUG   ] Finished updating ant stats in 1.228 seconds
2018-10-26 23:35:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-26 23:35:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-26 23:35:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:35:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:35:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:35:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:35:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:35:59 [DEBUG   ] Finished updating board flags in 1.875 seconds
2018-10-26 23:36:06 [DEBUG   ] Got command BAM from MCS: ref #281914
2018-10-26 23:36:06 [INFO    ] Finished processing BAM request
2018-10-26 23:36:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281914   8 58417 84966025 A  ERROR'
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 23:36:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 23:36:06 [DEBUG   ] spawn_process: at 2018-10-26 23:36:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 23:36:10 [DEBUG   ] Got command BAM from MCS: ref #281915
2018-10-26 23:36:10 [INFO    ] Finished processing BAM request
2018-10-26 23:36:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:36:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281915   8 58417 84970025 A  ERROR'
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 23:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 23:36:10 [DEBUG   ] spawn_process: at 2018-10-26 23:36:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 23:36:19 [DEBUG   ] Finished updating ant stats in 1.174 seconds
2018-10-26 23:36:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 23:36:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-10-26 23:36:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-26 23:36:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:36:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-26 23:36:59 [DEBUG   ] Finished updating ant stats in 1.029 seconds
2018-10-26 23:36:59 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-26 23:36:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-26 23:36:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 23:36:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:36:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:36:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:36:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:36:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:36:59 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-26 23:37:14 [DEBUG   ] Got command BAM from MCS: ref #281916
2018-10-26 23:37:14 [INFO    ] Finished processing BAM request
2018-10-26 23:37:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:37:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281916   8 58417 85034033 A  ERROR'
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 23:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 23:37:14 [DEBUG   ] spawn_process: at 2018-10-26 23:37:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 23:37:19 [DEBUG   ] Finished updating ant stats in 0.973 seconds
2018-10-26 23:37:22 [DEBUG   ] Got command BAM from MCS: ref #281917
2018-10-26 23:37:22 [INFO    ] Finished processing BAM request
2018-10-26 23:37:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:37:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281917   8 58417 85042033 A  ERROR'
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 23:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 23:37:22 [DEBUG   ] spawn_process: at 2018-10-26 23:37:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 23:37:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 23:37:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 23:37:58 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 23:37:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:37:58 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 23:37:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 23:37:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-26 23:37:59 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-26 23:37:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-26 23:37:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:37:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:37:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:37:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:37:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:37:59 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-10-26 23:38:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 23:38:22 [DEBUG   ] Got command BAM from MCS: ref #281922
2018-10-26 23:38:22 [INFO    ] Finished processing BAM request
2018-10-26 23:38:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281922   8 58417 85102025 A  ERROR'
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 23:38:22 [DEBUG   ] spawn_process: at 2018-10-26 23:38:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 23:38:34 [DEBUG   ] Got command BAM from MCS: ref #281923
2018-10-26 23:38:34 [INFO    ] Finished processing BAM request
2018-10-26 23:38:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281923   8 58417 85114029 A  ERROR'
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 23:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 23:38:34 [DEBUG   ] spawn_process: at 2018-10-26 23:38:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 23:38:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 23:38:45 [DEBUG   ] Got command RPT from MCS: ref #281924
2018-10-26 23:38:45 [DEBUG   ] summary = ERROR
2018-10-26 23:38:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281924  13 58417 85125545 A  ERRORERROR'
2018-10-26 23:38:45 [DEBUG   ] Got command RPT from MCS: ref #281925
2018-10-26 23:38:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:38:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281925  77 58417 85125749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:38:45 [DEBUG   ] Got command RPT from MCS: ref #281926
2018-10-26 23:38:45 [DEBUG   ] summary = ERROR
2018-10-26 23:38:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281926  13 58417 85125941 A  ERRORERROR'
2018-10-26 23:38:46 [DEBUG   ] Got command RPT from MCS: ref #281927
2018-10-26 23:38:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:38:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281927  77 58417 85126145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:38:46 [DEBUG   ] Got command RPT from MCS: ref #281928
2018-10-26 23:38:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 23:38:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281928  12 58417 85126349 A  ERRORB¥ff'
2018-10-26 23:38:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2018-10-26 23:38:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-26 23:38:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:38:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-26 23:38:59 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-26 23:38:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-26 23:38:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:38:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:38:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:38:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:38:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:38:59 [DEBUG   ] Finished updating board flags in 1.678 seconds
2018-10-26 23:39:19 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-10-26 23:39:30 [DEBUG   ] Got command BAM from MCS: ref #281929
2018-10-26 23:39:30 [INFO    ] Finished processing BAM request
2018-10-26 23:39:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:39:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281929   8 58417 85170029 A  ERROR'
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 23:39:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 23:39:30 [DEBUG   ] spawn_process: at 2018-10-26 23:39:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 23:39:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 23:39:46 [DEBUG   ] Got command BAM from MCS: ref #281930
2018-10-26 23:39:46 [INFO    ] Finished processing BAM request
2018-10-26 23:39:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:39:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281930   8 58417 85186033 A  ERROR'
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 23:39:46 [DEBUG   ] spawn_process: at 2018-10-26 23:39:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 23:39:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:39:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 23:39:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-26 23:39:59 [DEBUG   ] Finished updating ant stats in 0.627 seconds
2018-10-26 23:39:59 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-26 23:39:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-26 23:39:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 23:39:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:39:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:39:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:39:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:39:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:39:59 [DEBUG   ] Finished updating board flags in 1.350 seconds
2018-10-26 23:40:19 [DEBUG   ] Finished updating ant stats in 0.577 seconds
2018-10-26 23:40:37 [DEBUG   ] Got command RPT from MCS: ref #281932
2018-10-26 23:40:37 [DEBUG   ] summary = ERROR
2018-10-26 23:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281932  13 58417 85237549 A  ERRORERROR'
2018-10-26 23:40:37 [DEBUG   ] Got command RPT from MCS: ref #281933
2018-10-26 23:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281933  77 58417 85237550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:40:38 [DEBUG   ] Got command BAM from MCS: ref #281931
2018-10-26 23:40:38 [INFO    ] Finished processing BAM request
2018-10-26 23:40:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:40:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281931   8 58417 85238033 A  ERROR'
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 23:40:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 23:40:38 [DEBUG   ] spawn_process: at 2018-10-26 23:40:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 23:40:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 23:40:58 [DEBUG   ] Got command BAM from MCS: ref #281949
2018-10-26 23:40:58 [INFO    ] Finished processing BAM request
2018-10-26 23:40:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281949   8 58417 85258025 A  ERROR'
2018-10-26 23:40:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 23:40:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 23:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 23:40:58 [DEBUG   ] spawn_process: at 2018-10-26 23:40:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 23:40:59 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2018-10-26 23:40:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-26 23:40:59 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-26 23:40:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-26 23:40:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:40:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:40:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:40:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:40:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:40:59 [DEBUG   ] Finished updating board flags in 1.212 seconds
2018-10-26 23:41:19 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-10-26 23:41:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 23:41:46 [DEBUG   ] Got command BAM from MCS: ref #281954
2018-10-26 23:41:46 [INFO    ] Finished processing BAM request
2018-10-26 23:41:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:41:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281954   8 58417 85306033 A  ERROR'
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 23:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 23:41:46 [DEBUG   ] spawn_process: at 2018-10-26 23:41:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 23:41:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 23:41:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:41:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-26 23:41:59 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-26 23:41:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-26 23:41:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-26 23:41:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:41:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:41:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:41:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:41:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:41:59 [DEBUG   ] Finished updating board flags in 1.179 seconds
2018-10-26 23:42:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-26 23:42:10 [DEBUG   ] Got command BAM from MCS: ref #281955
2018-10-26 23:42:10 [INFO    ] Finished processing BAM request
2018-10-26 23:42:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:42:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281955   8 58417 85330029 A  ERROR'
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 23:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 23:42:10 [DEBUG   ] spawn_process: at 2018-10-26 23:42:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 23:42:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 23:42:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 23:42:54 [DEBUG   ] Got command BAM from MCS: ref #281956
2018-10-26 23:42:54 [INFO    ] Finished processing BAM request
2018-10-26 23:42:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:42:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281956   8 58417 85374037 A  ERROR'
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 23:42:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 23:42:54 [DEBUG   ] spawn_process: at 2018-10-26 23:42:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 23:42:59 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 23:42:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:43:00 [DEBUG   ] Finished updating ant stats in 1.228 seconds
2018-10-26 23:43:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-26 23:43:00 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-26 23:43:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-26 23:43:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 23:43:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:43:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:43:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:43:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:43:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:43:00 [DEBUG   ] Finished updating board flags in 2.033 seconds
2018-10-26 23:43:20 [DEBUG   ] Finished updating ant stats in 1.174 seconds
2018-10-26 23:43:22 [DEBUG   ] Got command BAM from MCS: ref #281957
2018-10-26 23:43:22 [INFO    ] Finished processing BAM request
2018-10-26 23:43:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281957   8 58417 85402029 A  ERROR'
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 23:43:22 [DEBUG   ] spawn_process: at 2018-10-26 23:43:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 23:43:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 23:43:45 [DEBUG   ] Got command RPT from MCS: ref #281960
2018-10-26 23:43:45 [DEBUG   ] summary = ERROR
2018-10-26 23:43:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281960  13 58417 85425629 A  ERRORERROR'
2018-10-26 23:43:45 [DEBUG   ] Got command RPT from MCS: ref #281961
2018-10-26 23:43:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:43:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281961  77 58417 85425833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:43:46 [DEBUG   ] Got command RPT from MCS: ref #281962
2018-10-26 23:43:46 [DEBUG   ] summary = ERROR
2018-10-26 23:43:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281962  13 58417 85426025 A  ERRORERROR'
2018-10-26 23:43:46 [DEBUG   ] Got command RPT from MCS: ref #281964
2018-10-26 23:43:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:43:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281964  77 58417 85426229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:43:46 [DEBUG   ] Got command RPT from MCS: ref #281965
2018-10-26 23:43:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 23:43:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281965  12 58417 85426433 A  ERRORB¥ff'
2018-10-26 23:43:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-26 23:43:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 23:43:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:44:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 23:44:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-26 23:44:00 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-26 23:44:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-26 23:44:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 23:44:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:44:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:44:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:44:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:44:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:44:00 [DEBUG   ] Finished updating board flags in 2.143 seconds
2018-10-26 23:44:02 [DEBUG   ] Got command BAM from MCS: ref #281970
2018-10-26 23:44:02 [INFO    ] Finished processing BAM request
2018-10-26 23:44:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:44:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281970   8 58417 85442029 A  ERROR'
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 23:44:02 [DEBUG   ] spawn_process: at 2018-10-26 23:44:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 23:44:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-26 23:44:34 [DEBUG   ] Got command BAM from MCS: ref #281975
2018-10-26 23:44:34 [INFO    ] Finished processing BAM request
2018-10-26 23:44:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:44:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281975   8 58417 85474033 A  ERROR'
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 23:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 23:44:34 [DEBUG   ] spawn_process: at 2018-10-26 23:44:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 23:44:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 23:44:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:45:00 [DEBUG   ] Finished updating ant stats in 1.028 seconds
2018-10-26 23:45:00 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-26 23:45:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-26 23:45:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 23:45:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:45:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:45:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:45:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:45:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:45:00 [DEBUG   ] Finished updating board flags in 1.842 seconds
2018-10-26 23:45:10 [DEBUG   ] Got command BAM from MCS: ref #281976
2018-10-26 23:45:10 [INFO    ] Finished processing BAM request
2018-10-26 23:45:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:45:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281976   8 58417 85510025 A  ERROR'
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 23:45:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 23:45:10 [DEBUG   ] spawn_process: at 2018-10-26 23:45:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 23:45:20 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2018-10-26 23:45:37 [DEBUG   ] Got command RPT from MCS: ref #281977
2018-10-26 23:45:37 [DEBUG   ] summary = ERROR
2018-10-26 23:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281977  13 58417 85537549 A  ERRORERROR'
2018-10-26 23:45:37 [DEBUG   ] Got command RPT from MCS: ref #281978
2018-10-26 23:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   281978  77 58417 85537550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:45:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 23:45:46 [DEBUG   ] Got command BAM from MCS: ref #281994
2018-10-26 23:45:46 [INFO    ] Finished processing BAM request
2018-10-26 23:45:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:45:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281994   8 58417 85546025 A  ERROR'
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 23:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 23:45:46 [DEBUG   ] spawn_process: at 2018-10-26 23:45:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 23:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 23:45:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-26 23:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 23:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-26 23:45:59 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-26 23:45:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-26 23:45:59 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 23:45:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:45:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:45:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:45:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:45:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:45:59 [DEBUG   ] Finished updating board flags in 1.226 seconds
2018-10-26 23:46:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 23:46:18 [DEBUG   ] Got command BAM from MCS: ref #281995
2018-10-26 23:46:18 [INFO    ] Finished processing BAM request
2018-10-26 23:46:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:46:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281995   8 58417 85578025 A  ERROR'
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 23:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 23:46:18 [DEBUG   ] spawn_process: at 2018-10-26 23:46:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 23:46:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 23:46:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 23:46:58 [DEBUG   ] Got command BAM from MCS: ref #281996
2018-10-26 23:46:58 [INFO    ] Finished processing BAM request
2018-10-26 23:46:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:46:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   281996   8 58417 85618026 A  ERROR'
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 23:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 23:46:58 [DEBUG   ] spawn_process: at 2018-10-26 23:46:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 23:46:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 23:46:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:46:59 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-26 23:46:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-26 23:46:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 23:46:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:46:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:46:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:46:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:46:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:46:59 [DEBUG   ] Finished updating board flags in 1.218 seconds
2018-10-26 23:47:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 23:47:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 23:47:26 [DEBUG   ] Got command BAM from MCS: ref #282001
2018-10-26 23:47:26 [INFO    ] Finished processing BAM request
2018-10-26 23:47:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:47:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282001   8 58417 85646033 A  ERROR'
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 23:47:26 [DEBUG   ] spawn_process: at 2018-10-26 23:47:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 23:47:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 23:47:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:47:59 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-26 23:47:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-26 23:47:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:47:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:47:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:47:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:47:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:47:59 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-10-26 23:48:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 23:48:10 [DEBUG   ] Got command BAM from MCS: ref #282002
2018-10-26 23:48:10 [INFO    ] Finished processing BAM request
2018-10-26 23:48:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:48:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282002   8 58417 85690029 A  ERROR'
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 23:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 23:48:10 [DEBUG   ] spawn_process: at 2018-10-26 23:48:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 23:48:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 23:48:34 [DEBUG   ] Got command BAM from MCS: ref #282003
2018-10-26 23:48:34 [INFO    ] Finished processing BAM request
2018-10-26 23:48:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282003   8 58417 85714025 A  ERROR'
2018-10-26 23:48:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 23:48:34 [DEBUG   ] spawn_process: at 2018-10-26 23:48:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 23:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 23:48:35 [DEBUG   ] spawn_process: at 2018-10-26 23:48:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 23:48:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 23:48:45 [DEBUG   ] Got command RPT from MCS: ref #282004
2018-10-26 23:48:45 [DEBUG   ] summary = ERROR
2018-10-26 23:48:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282004  13 58417 85725717 A  ERRORERROR'
2018-10-26 23:48:45 [DEBUG   ] Got command RPT from MCS: ref #282005
2018-10-26 23:48:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:48:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282005  77 58417 85725921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:48:46 [DEBUG   ] Got command RPT from MCS: ref #282006
2018-10-26 23:48:46 [DEBUG   ] summary = ERROR
2018-10-26 23:48:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282006  13 58417 85726113 A  ERRORERROR'
2018-10-26 23:48:46 [DEBUG   ] Got command RPT from MCS: ref #282007
2018-10-26 23:48:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:48:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282007  77 58417 85726317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:48:46 [DEBUG   ] Got command RPT from MCS: ref #282008
2018-10-26 23:48:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 23:48:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282008  12 58417 85726521 A  ERRORB¥ff'
2018-10-26 23:48:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-10-26 23:48:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-26 23:48:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 3
2018-10-26 23:48:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:48:59 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-26 23:48:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-26 23:48:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:48:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:48:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:48:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:48:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:48:59 [DEBUG   ] Finished updating board flags in 1.188 seconds
2018-10-26 23:49:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-26 23:49:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 23:49:22 [DEBUG   ] Got command BAM from MCS: ref #282009
2018-10-26 23:49:22 [INFO    ] Finished processing BAM request
2018-10-26 23:49:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:49:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282009   8 58417 85762029 A  ERROR'
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 23:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 23:49:22 [DEBUG   ] spawn_process: at 2018-10-26 23:49:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 23:49:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 23:49:42 [DEBUG   ] Got command BAM from MCS: ref #282010
2018-10-26 23:49:42 [INFO    ] Finished processing BAM request
2018-10-26 23:49:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:49:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282010   8 58417 85782025 A  ERROR'
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 23:49:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 23:49:42 [DEBUG   ] spawn_process: at 2018-10-26 23:49:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 23:49:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-10-26 23:49:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:49:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 23:49:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 23:49:59 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-26 23:49:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-26 23:49:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:49:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:49:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:49:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:49:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:49:59 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-10-26 23:50:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 23:50:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-26 23:50:34 [DEBUG   ] Got command BAM from MCS: ref #282015
2018-10-26 23:50:34 [INFO    ] Finished processing BAM request
2018-10-26 23:50:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:50:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282015   8 58417 85834025 A  ERROR'
2018-10-26 23:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 23:50:34 [DEBUG   ] spawn_process: at 2018-10-26 23:50:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 23:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 23:50:35 [DEBUG   ] spawn_process: at 2018-10-26 23:50:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 23:50:37 [DEBUG   ] Got command RPT from MCS: ref #282016
2018-10-26 23:50:37 [DEBUG   ] summary = ERROR
2018-10-26 23:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282016  13 58417 85837553 A  ERRORERROR'
2018-10-26 23:50:37 [DEBUG   ] Got command RPT from MCS: ref #282017
2018-10-26 23:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282017  77 58417 85837554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:50:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 23:50:50 [DEBUG   ] Got command BAM from MCS: ref #282033
2018-10-26 23:50:50 [INFO    ] Finished processing BAM request
2018-10-26 23:50:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:50:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282033   8 58417 85850025 A  ERROR'
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 23:50:50 [DEBUG   ] spawn_process: at 2018-10-26 23:50:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 23:50:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-26 23:50:59 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 23:50:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:50:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-26 23:50:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-26 23:50:59 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-26 23:50:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-26 23:50:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:50:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:50:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:50:59 [WARNING ] (13, 1, 'bot')
2018-10-26 23:50:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:50:59 [DEBUG   ] Finished updating board flags in 0.985 seconds
2018-10-26 23:51:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 23:51:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 23:51:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-26 23:51:46 [DEBUG   ] Got command BAM from MCS: ref #282034
2018-10-26 23:51:46 [INFO    ] Finished processing BAM request
2018-10-26 23:51:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282034   8 58417 85906025 A  ERROR'
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 23:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 23:51:46 [DEBUG   ] spawn_process: at 2018-10-26 23:51:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 23:51:58 [DEBUG   ] Got command BAM from MCS: ref #282035
2018-10-26 23:51:58 [INFO    ] Finished processing BAM request
2018-10-26 23:51:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:51:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282035   8 58417 85918029 A  ERROR'
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 23:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 23:51:58 [DEBUG   ] spawn_process: at 2018-10-26 23:51:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 23:51:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 23:51:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:51:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-26 23:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-26 23:52:00 [DEBUG   ] Finished updating ant stats in 0.628 seconds
2018-10-26 23:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-26 23:52:00 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-26 23:52:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-26 23:52:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:52:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:52:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:52:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:52:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:52:00 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-10-26 23:52:20 [DEBUG   ] Finished updating ant stats in 0.573 seconds
2018-10-26 23:52:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 23:52:58 [DEBUG   ] Got command BAM from MCS: ref #282036
2018-10-26 23:52:58 [INFO    ] Finished processing BAM request
2018-10-26 23:52:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:52:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282036   8 58417 85978025 A  ERROR'
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-26 23:52:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-26 23:52:58 [DEBUG   ] spawn_process: at 2018-10-26 23:52:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-26 23:52:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-10-26 23:52:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-26 23:52:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:53:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-26 23:53:00 [DEBUG   ] Finished updating ant stats in 0.428 seconds
2018-10-26 23:53:00 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-26 23:53:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-26 23:53:00 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 23:53:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:53:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:53:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:53:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:53:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:53:00 [DEBUG   ] Finished updating board flags in 1.218 seconds
2018-10-26 23:53:06 [DEBUG   ] Got command BAM from MCS: ref #282041
2018-10-26 23:53:06 [INFO    ] Finished processing BAM request
2018-10-26 23:53:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:53:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282041   8 58417 85986025 A  ERROR'
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 23:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 23:53:06 [DEBUG   ] spawn_process: at 2018-10-26 23:53:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 23:53:20 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-10-26 23:53:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 23:53:45 [DEBUG   ] Got command RPT from MCS: ref #282044
2018-10-26 23:53:45 [DEBUG   ] summary = ERROR
2018-10-26 23:53:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282044  13 58417 86025805 A  ERRORERROR'
2018-10-26 23:53:45 [DEBUG   ] Got command RPT from MCS: ref #282045
2018-10-26 23:53:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:53:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282045  77 58417 86025997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:53:46 [DEBUG   ] Got command RPT from MCS: ref #282046
2018-10-26 23:53:46 [DEBUG   ] summary = ERROR
2018-10-26 23:53:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282046  13 58417 86026201 A  ERRORERROR'
2018-10-26 23:53:46 [DEBUG   ] Got command RPT from MCS: ref #282048
2018-10-26 23:53:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:53:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282048  77 58417 86026405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:53:46 [DEBUG   ] Got command RPT from MCS: ref #282049
2018-10-26 23:53:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 23:53:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282049  12 58417 86026609 A  ERRORB¥ff'
2018-10-26 23:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-26 23:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 23:53:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 23:53:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-26 23:53:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:54:00 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-26 23:54:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-26 23:54:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:54:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:54:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:54:00 [WARNING ] (13, 1, 'bot')
2018-10-26 23:54:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:54:00 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-10-26 23:54:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 23:54:10 [DEBUG   ] Got command BAM from MCS: ref #282054
2018-10-26 23:54:10 [INFO    ] Finished processing BAM request
2018-10-26 23:54:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:54:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282054   8 58417 86050029 A  ERROR'
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 23:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 23:54:10 [DEBUG   ] spawn_process: at 2018-10-26 23:54:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 23:54:14 [DEBUG   ] Got command BAM from MCS: ref #282055
2018-10-26 23:54:14 [INFO    ] Finished processing BAM request
2018-10-26 23:54:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:54:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282055   8 58417 86054033 A  ERROR'
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 23:54:14 [DEBUG   ] spawn_process: at 2018-10-26 23:54:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 23:54:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 23:54:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-26 23:54:58 [DEBUG   ] Got command BAM from MCS: ref #282056
2018-10-26 23:54:58 [INFO    ] Finished processing BAM request
2018-10-26 23:54:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282056   8 58417 86098033 A  ERROR'
2018-10-26 23:54:58 [DEBUG   ] Got command BAM from MCS: ref #282057
2018-10-26 23:54:58 [INFO    ] Finished processing BAM request
2018-10-26 23:54:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282057   8 58417 86098037 A  ERROR'
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 23:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 23:54:58 [DEBUG   ] spawn_process: at 2018-10-26 23:54:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 23:55:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-26 23:55:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:55:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-26 23:55:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-26 23:55:02 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-26 23:55:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-26 23:55:02 [WARNING ] (13, 1, 'bot')
2018-10-26 23:55:02 [WARNING ] (13, 1, 'bot')
2018-10-26 23:55:02 [WARNING ] (13, 1, 'bot')
2018-10-26 23:55:02 [WARNING ] (13, 1, 'bot')
2018-10-26 23:55:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:55:02 [DEBUG   ] Finished updating board flags in 3.011 seconds
2018-10-26 23:55:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-26 23:55:37 [DEBUG   ] Got command RPT from MCS: ref #282060
2018-10-26 23:55:37 [DEBUG   ] summary = ERROR
2018-10-26 23:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282060  13 58417 86137553 A  ERRORERROR'
2018-10-26 23:55:37 [DEBUG   ] Got command RPT from MCS: ref #282061
2018-10-26 23:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282061  77 58417 86137554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:55:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-26 23:55:48 [DEBUG   ] Got command BAM from MCS: ref #282077
2018-10-26 23:55:48 [INFO    ] Finished processing BAM request
2018-10-26 23:55:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282077   8 58417 86148033 A  ERROR'
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 23:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 23:55:48 [DEBUG   ] spawn_process: at 2018-10-26 23:55:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 23:55:51 [DEBUG   ] Got command BAM from MCS: ref #282078
2018-10-26 23:55:51 [INFO    ] Finished processing BAM request
2018-10-26 23:55:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:55:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282078   8 58417 86151025 A  ERROR'
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 23:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 23:55:51 [DEBUG   ] spawn_process: at 2018-10-26 23:55:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 23:56:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 23:56:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:56:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-26 23:56:01 [DEBUG   ] Finished updating ant stats in 1.029 seconds
2018-10-26 23:56:01 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-26 23:56:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-26 23:56:01 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 23:56:01 [WARNING ] (13, 1, 'bot')
2018-10-26 23:56:01 [WARNING ] (13, 1, 'bot')
2018-10-26 23:56:01 [WARNING ] (13, 1, 'bot')
2018-10-26 23:56:01 [WARNING ] (13, 1, 'bot')
2018-10-26 23:56:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:56:01 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-10-26 23:56:21 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2018-10-26 23:56:38 [DEBUG   ] Got command BAM from MCS: ref #282083
2018-10-26 23:56:38 [INFO    ] Finished processing BAM request
2018-10-26 23:56:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282083   8 58417 86198025 A  ERROR'
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 23:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 23:56:38 [DEBUG   ] spawn_process: at 2018-10-26 23:56:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 23:56:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-26 23:56:43 [DEBUG   ] Got command BAM from MCS: ref #282084
2018-10-26 23:56:43 [INFO    ] Finished processing BAM request
2018-10-26 23:56:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282084   8 58417 86203025 A  ERROR'
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 23:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 23:56:43 [DEBUG   ] spawn_process: at 2018-10-26 23:56:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 23:56:58 [DEBUG   ] Got command BAM from MCS: ref #282086
2018-10-26 23:56:58 [INFO    ] Finished processing BAM request
2018-10-26 23:56:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:56:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282086   8 58417 86218029 A  ERROR'
2018-10-26 23:56:58 [DEBUG   ] Got command BAM from MCS: ref #282085
2018-10-26 23:56:58 [INFO    ] Finished processing BAM request
2018-10-26 23:56:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:56:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282085   8 58417 86218033 A  ERROR'
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-26 23:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-26 23:56:58 [DEBUG   ] spawn_process: at 2018-10-26 23:56:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-26 23:57:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-26 23:57:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-26 23:57:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-26 23:57:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:57:01 [DEBUG   ] Finished updating ant stats in 0.828 seconds
2018-10-26 23:57:01 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-26 23:57:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-26 23:57:01 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 23:57:01 [WARNING ] (13, 1, 'bot')
2018-10-26 23:57:01 [WARNING ] (13, 1, 'bot')
2018-10-26 23:57:01 [WARNING ] (13, 1, 'bot')
2018-10-26 23:57:01 [WARNING ] (13, 1, 'bot')
2018-10-26 23:57:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:57:01 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-10-26 23:57:21 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2018-10-26 23:57:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-26 23:58:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-10-26 23:58:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:58:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2018-10-26 23:58:01 [DEBUG   ] Finished updating ant stats in 0.628 seconds
2018-10-26 23:58:01 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-26 23:58:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-26 23:58:01 [WARNING ] (13, 1, 'bot')
2018-10-26 23:58:01 [WARNING ] (13, 1, 'bot')
2018-10-26 23:58:01 [WARNING ] (13, 1, 'bot')
2018-10-26 23:58:01 [WARNING ] (13, 1, 'bot')
2018-10-26 23:58:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:58:01 [DEBUG   ] Finished updating board flags in 1.797 seconds
2018-10-26 23:58:06 [DEBUG   ] Got command BAM from MCS: ref #282089
2018-10-26 23:58:06 [INFO    ] Finished processing BAM request
2018-10-26 23:58:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:58:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282089   8 58417 86286029 A  ERROR'
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-26 23:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-26 23:58:06 [DEBUG   ] spawn_process: at 2018-10-26 23:58:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-26 23:58:10 [DEBUG   ] Got command BAM from MCS: ref #282090
2018-10-26 23:58:10 [INFO    ] Finished processing BAM request
2018-10-26 23:58:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:58:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282090   8 58417 86290029 A  ERROR'
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 23:58:10 [DEBUG   ] spawn_process: at 2018-10-26 23:58:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 23:58:21 [DEBUG   ] Finished updating ant stats in 0.573 seconds
2018-10-26 23:58:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-26 23:58:45 [DEBUG   ] Got command RPT from MCS: ref #282091
2018-10-26 23:58:45 [DEBUG   ] summary = ERROR
2018-10-26 23:58:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282091  13 58417 86325885 A  ERRORERROR'
2018-10-26 23:58:46 [DEBUG   ] Got command RPT from MCS: ref #282092
2018-10-26 23:58:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:58:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282092  77 58417 86326089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:58:46 [DEBUG   ] Got command RPT from MCS: ref #282093
2018-10-26 23:58:46 [DEBUG   ] summary = ERROR
2018-10-26 23:58:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282093  13 58417 86326293 A  ERRORERROR'
2018-10-26 23:58:46 [DEBUG   ] Got command RPT from MCS: ref #282094
2018-10-26 23:58:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-26 23:58:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282094  77 58417 86326485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-26 23:58:46 [DEBUG   ] Got command RPT from MCS: ref #282095
2018-10-26 23:58:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-26 23:58:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282095  12 58417 86326689 A  ERRORB¦ff'
2018-10-26 23:59:00 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-26 23:59:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-26 23:59:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-26 23:59:01 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2018-10-26 23:59:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-26 23:59:01 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-26 23:59:01 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-26 23:59:01 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-26 23:59:01 [WARNING ] (13, 1, 'bot')
2018-10-26 23:59:01 [WARNING ] (13, 1, 'bot')
2018-10-26 23:59:01 [WARNING ] (13, 1, 'bot')
2018-10-26 23:59:01 [WARNING ] (13, 1, 'bot')
2018-10-26 23:59:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-26 23:59:01 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-26 23:59:14 [DEBUG   ] Got command BAM from MCS: ref #282100
2018-10-26 23:59:14 [INFO    ] Finished processing BAM request
2018-10-26 23:59:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:59:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282100   8 58417 86354029 A  ERROR'
2018-10-26 23:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-26 23:59:14 [DEBUG   ] spawn_process: at 2018-10-26 23:59:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-26 23:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-26 23:59:15 [DEBUG   ] spawn_process: at 2018-10-26 23:59:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-26 23:59:21 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-10-26 23:59:22 [DEBUG   ] Got command BAM from MCS: ref #282101
2018-10-26 23:59:22 [INFO    ] Finished processing BAM request
2018-10-26 23:59:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-26 23:59:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282101   8 58417 86362025 A  ERROR'
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-26 23:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-26 23:59:22 [DEBUG   ] spawn_process: at 2018-10-26 23:59:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-26 23:59:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:00:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:00:00 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:00:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:00:00 [WARNING ] (13, 1, 'bot')
2018-10-27 00:00:00 [WARNING ] (13, 1, 'bot')
2018-10-27 00:00:00 [WARNING ] (13, 1, 'bot')
2018-10-27 00:00:00 [WARNING ] (13, 1, 'bot')
2018-10-27 00:00:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:00:00 [DEBUG   ] Finished updating board flags in 0.969 seconds
2018-10-27 00:00:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:00:22 [DEBUG   ] Got command BAM from MCS: ref #282102
2018-10-27 00:00:22 [INFO    ] Finished processing BAM request
2018-10-27 00:00:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:00:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282102   8 58418    22034 A  ERROR'
2018-10-27 00:00:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 00:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 00:00:22 [DEBUG   ] spawn_process: at 2018-10-27 00:00:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 00:00:34 [DEBUG   ] Got command BAM from MCS: ref #282103
2018-10-27 00:00:34 [INFO    ] Finished processing BAM request
2018-10-27 00:00:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:00:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282103   8 58418    34025 A  ERROR'
2018-10-27 00:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:00:34 [DEBUG   ] spawn_process: at 2018-10-27 00:00:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:00:35 [DEBUG   ] spawn_process: at 2018-10-27 00:00:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:00:37 [DEBUG   ] Got command RPT from MCS: ref #282104
2018-10-27 00:00:37 [DEBUG   ] summary = ERROR
2018-10-27 00:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282104  13 58418    37553 A  ERRORERROR'
2018-10-27 00:00:37 [DEBUG   ] Got command RPT from MCS: ref #282105
2018-10-27 00:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282105  77 58418    37554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:00:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:01:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-27 00:01:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-27 00:01:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:01:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 00:01:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:01:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 00:01:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-27 00:01:01 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:01:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:01:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:01:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:01:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:01:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:01:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:01:01 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-10-27 00:01:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:01:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:01:30 [DEBUG   ] Got command BAM from MCS: ref #282121
2018-10-27 00:01:30 [INFO    ] Finished processing BAM request
2018-10-27 00:01:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:01:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282121   8 58418    90025 A  ERROR'
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:01:30 [DEBUG   ] spawn_process: at 2018-10-27 00:01:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:01:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:01:46 [DEBUG   ] Got command BAM from MCS: ref #282122
2018-10-27 00:01:46 [INFO    ] Finished processing BAM request
2018-10-27 00:01:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:01:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282122   8 58418   106029 A  ERROR'
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 00:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 00:01:46 [DEBUG   ] spawn_process: at 2018-10-27 00:01:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 00:02:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:02:01 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:02:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:02:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 00:02:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:02:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:02:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:02:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:02:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:02:01 [DEBUG   ] Finished updating board flags in 1.215 seconds
2018-10-27 00:02:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:02:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:02:38 [DEBUG   ] Got command BAM from MCS: ref #282127
2018-10-27 00:02:38 [INFO    ] Finished processing BAM request
2018-10-27 00:02:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:02:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282127   8 58418   158029 A  ERROR'
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:02:38 [DEBUG   ] spawn_process: at 2018-10-27 00:02:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:02:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:02:58 [DEBUG   ] Got command BAM from MCS: ref #282128
2018-10-27 00:02:58 [INFO    ] Finished processing BAM request
2018-10-27 00:02:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:02:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282128   8 58418   178025 A  ERROR'
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:02:58 [DEBUG   ] spawn_process: at 2018-10-27 00:02:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:03:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:03:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:03:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:03:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 00:03:01 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:03:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:03:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:03:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:03:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:03:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:03:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:03:01 [DEBUG   ] Finished updating board flags in 1.201 seconds
2018-10-27 00:03:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 00:03:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:03:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 00:03:45 [DEBUG   ] Got command RPT from MCS: ref #282132
2018-10-27 00:03:45 [DEBUG   ] summary = ERROR
2018-10-27 00:03:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282132  13 58418   225965 A  ERRORERROR'
2018-10-27 00:03:46 [DEBUG   ] Got command BAM from MCS: ref #282131
2018-10-27 00:03:46 [INFO    ] Finished processing BAM request
2018-10-27 00:03:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:03:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282131   8 58418   226029 A  ERROR'
2018-10-27 00:03:46 [DEBUG   ] Got command RPT from MCS: ref #282133
2018-10-27 00:03:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:03:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282133  77 58418   226173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:03:46 [DEBUG   ] Got command RPT from MCS: ref #282134
2018-10-27 00:03:46 [DEBUG   ] summary = ERROR
2018-10-27 00:03:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282134  13 58418   226377 A  ERRORERROR'
2018-10-27 00:03:46 [DEBUG   ] Got command RPT from MCS: ref #282136
2018-10-27 00:03:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:03:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282136  77 58418   226569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:03:46 [DEBUG   ] Got command RPT from MCS: ref #282137
2018-10-27 00:03:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 00:03:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282137  12 58418   226773 A  ERRORB¦ff'
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:03:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:03:46 [DEBUG   ] spawn_process: at 2018-10-27 00:03:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:04:00 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:04:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:04:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-27 00:04:01 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:04:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:04:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:04:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:04:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:04:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:04:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:04:01 [DEBUG   ] Finished updating board flags in 1.163 seconds
2018-10-27 00:04:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:04:09 [DEBUG   ] Got command BAM from MCS: ref #282142
2018-10-27 00:04:09 [INFO    ] Finished processing BAM request
2018-10-27 00:04:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:04:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282142   8 58418   249033 A  ERROR'
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:04:09 [DEBUG   ] spawn_process: at 2018-10-27 00:04:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:04:22 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-27 00:04:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:04:54 [DEBUG   ] Got command BAM from MCS: ref #282143
2018-10-27 00:04:54 [INFO    ] Finished processing BAM request
2018-10-27 00:04:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:04:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282143   8 58418   294045 A  ERROR'
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:04:55 [DEBUG   ] spawn_process: at 2018-10-27 00:04:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:05:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 00:05:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:05:01 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:05:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:05:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 00:05:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 00:05:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:05:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:05:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:05:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:05:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:05:01 [DEBUG   ] Finished updating board flags in 0.989 seconds
2018-10-27 00:05:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 00:05:20 [DEBUG   ] Got command BAM from MCS: ref #282148
2018-10-27 00:05:20 [INFO    ] Finished processing BAM request
2018-10-27 00:05:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:05:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282148   8 58418   320025 A  ERROR'
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:05:20 [DEBUG   ] spawn_process: at 2018-10-27 00:05:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:05:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:05:37 [DEBUG   ] Got command RPT from MCS: ref #282149
2018-10-27 00:05:37 [DEBUG   ] summary = ERROR
2018-10-27 00:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282149  13 58418   337557 A  ERRORERROR'
2018-10-27 00:05:37 [DEBUG   ] Got command RPT from MCS: ref #282150
2018-10-27 00:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282150  77 58418   337558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:05:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:06:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:06:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:06:02 [DEBUG   ] Got command BAM from MCS: ref #282166
2018-10-27 00:06:02 [INFO    ] Finished processing BAM request
2018-10-27 00:06:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:06:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282166   8 58418   362037 A  ERROR'
2018-10-27 00:06:02 [DEBUG   ] Finished updating ant stats in 0.630 seconds
2018-10-27 00:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 00:06:02 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:06:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:06:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:06:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:06:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:06:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:06:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:06:02 [DEBUG   ] Finished updating board flags in 1.869 seconds
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:06:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:06:02 [DEBUG   ] spawn_process: at 2018-10-27 00:06:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:06:22 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-10-27 00:06:31 [DEBUG   ] Got command BAM from MCS: ref #282167
2018-10-27 00:06:31 [INFO    ] Finished processing BAM request
2018-10-27 00:06:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:06:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282167   8 58418   391033 A  ERROR'
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:06:31 [DEBUG   ] spawn_process: at 2018-10-27 00:06:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:06:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 00:07:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-10-27 00:07:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:07:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:07:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:07:02 [DEBUG   ] Finished updating ant stats in 0.428 seconds
2018-10-27 00:07:02 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:07:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:07:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 00:07:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:07:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:07:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:07:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:07:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:07:02 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-10-27 00:07:10 [DEBUG   ] Got command BAM from MCS: ref #282168
2018-10-27 00:07:10 [INFO    ] Finished processing BAM request
2018-10-27 00:07:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:07:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282168   8 58418   430029 A  ERROR'
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:07:10 [DEBUG   ] spawn_process: at 2018-10-27 00:07:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:07:22 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-10-27 00:07:42 [DEBUG   ] Got command BAM from MCS: ref #282169
2018-10-27 00:07:42 [INFO    ] Finished processing BAM request
2018-10-27 00:07:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:07:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282169   8 58418   462033 A  ERROR'
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:07:42 [DEBUG   ] spawn_process: at 2018-10-27 00:07:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:07:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 00:08:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-10-27 00:08:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-27 00:08:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:08:01 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:08:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:08:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:08:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:08:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:08:01 [WARNING ] (13, 1, 'bot')
2018-10-27 00:08:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:08:01 [DEBUG   ] Finished updating board flags in 1.000 seconds
2018-10-27 00:08:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:08:18 [DEBUG   ] Got command BAM from MCS: ref #282174
2018-10-27 00:08:18 [INFO    ] Finished processing BAM request
2018-10-27 00:08:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282174   8 58418   498025 A  ERROR'
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:08:18 [DEBUG   ] spawn_process: at 2018-10-27 00:08:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:08:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:08:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:08:46 [DEBUG   ] Got command RPT from MCS: ref #282175
2018-10-27 00:08:46 [DEBUG   ] summary = ERROR
2018-10-27 00:08:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282175  13 58418   526061 A  ERRORERROR'
2018-10-27 00:08:46 [DEBUG   ] Got command RPT from MCS: ref #282176
2018-10-27 00:08:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:08:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282176  77 58418   526253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:08:46 [DEBUG   ] Got command RPT from MCS: ref #282177
2018-10-27 00:08:46 [DEBUG   ] summary = ERROR
2018-10-27 00:08:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282177  13 58418   526457 A  ERRORERROR'
2018-10-27 00:08:46 [DEBUG   ] Got command RPT from MCS: ref #282178
2018-10-27 00:08:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:08:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282178  77 58418   526661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:08:46 [DEBUG   ] Got command RPT from MCS: ref #282179
2018-10-27 00:08:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 00:08:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282179  12 58418   526865 A  ERRORB¥ff'
2018-10-27 00:08:53 [DEBUG   ] Got command BAM from MCS: ref #282180
2018-10-27 00:08:53 [INFO    ] Finished processing BAM request
2018-10-27 00:08:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:08:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282180   8 58418   533025 A  ERROR'
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:08:53 [DEBUG   ] spawn_process: at 2018-10-27 00:08:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:09:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:09:02 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:09:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:09:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:09:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:09:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:09:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:09:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:09:02 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-10-27 00:09:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:09:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:09:26 [DEBUG   ] Got command BAM from MCS: ref #282181
2018-10-27 00:09:26 [INFO    ] Finished processing BAM request
2018-10-27 00:09:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:09:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282181   8 58418   566033 A  ERROR'
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:09:26 [DEBUG   ] spawn_process: at 2018-10-27 00:09:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:09:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:10:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:10:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 00:10:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:10:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 00:10:02 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:10:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 00:10:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:10:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 00:10:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:10:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:10:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:10:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:10:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:10:03 [DEBUG   ] Finished updating board flags in 2.296 seconds
2018-10-27 00:10:04 [DEBUG   ] Got command BAM from MCS: ref #282182
2018-10-27 00:10:04 [INFO    ] Finished processing BAM request
2018-10-27 00:10:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:10:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282182   8 58418   604029 A  ERROR'
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:10:04 [DEBUG   ] spawn_process: at 2018-10-27 00:10:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:10:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-27 00:10:34 [DEBUG   ] Got command BAM from MCS: ref #282183
2018-10-27 00:10:34 [INFO    ] Finished processing BAM request
2018-10-27 00:10:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:10:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282183   8 58418   634033 A  ERROR'
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:10:34 [DEBUG   ] spawn_process: at 2018-10-27 00:10:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:10:37 [DEBUG   ] Got command RPT from MCS: ref #282184
2018-10-27 00:10:37 [DEBUG   ] summary = ERROR
2018-10-27 00:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282184  13 58418   637549 A  ERRORERROR'
2018-10-27 00:10:37 [DEBUG   ] Got command RPT from MCS: ref #282185
2018-10-27 00:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282185  77 58418   637550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:10:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:11:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-27 00:11:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:11:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 00:11:02 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:11:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:11:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 00:11:02 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 00:11:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:11:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:11:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:11:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:11:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:11:02 [DEBUG   ] Finished updating board flags in 1.268 seconds
2018-10-27 00:11:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:11:15 [DEBUG   ] Got command BAM from MCS: ref #282205
2018-10-27 00:11:15 [INFO    ] Finished processing BAM request
2018-10-27 00:11:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:11:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282205   8 58418   675025 A  ERROR'
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:11:15 [DEBUG   ] spawn_process: at 2018-10-27 00:11:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:11:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:11:42 [DEBUG   ] Got command BAM from MCS: ref #282206
2018-10-27 00:11:42 [INFO    ] Finished processing BAM request
2018-10-27 00:11:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:11:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282206   8 58418   702029 A  ERROR'
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:11:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:11:42 [DEBUG   ] spawn_process: at 2018-10-27 00:11:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:11:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:12:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-27 00:12:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:12:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:12:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 00:12:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 00:12:02 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:12:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:12:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 00:12:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:12:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:12:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:12:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:12:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:12:02 [DEBUG   ] Finished updating board flags in 1.181 seconds
2018-10-27 00:12:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:12:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:12:26 [DEBUG   ] Got command BAM from MCS: ref #282207
2018-10-27 00:12:26 [INFO    ] Finished processing BAM request
2018-10-27 00:12:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:12:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282207   8 58418   746025 A  ERROR'
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:12:26 [DEBUG   ] spawn_process: at 2018-10-27 00:12:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:12:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:12:50 [DEBUG   ] Got command BAM from MCS: ref #282208
2018-10-27 00:12:50 [INFO    ] Finished processing BAM request
2018-10-27 00:12:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:12:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282208   8 58418   770029 A  ERROR'
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:12:50 [DEBUG   ] spawn_process: at 2018-10-27 00:12:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:13:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 00:13:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:13:02 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:13:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:13:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2018-10-27 00:13:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:13:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:13:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:13:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:13:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:13:02 [DEBUG   ] Finished updating board flags in 0.992 seconds
2018-10-27 00:13:03 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-27 00:13:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 00:13:37 [DEBUG   ] Got command BAM from MCS: ref #282211
2018-10-27 00:13:37 [INFO    ] Finished processing BAM request
2018-10-27 00:13:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282211   8 58418   817025 A  ERROR'
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:13:37 [DEBUG   ] spawn_process: at 2018-10-27 00:13:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:13:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:13:46 [DEBUG   ] Got command RPT from MCS: ref #282212
2018-10-27 00:13:46 [DEBUG   ] summary = ERROR
2018-10-27 00:13:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282212  13 58418   826145 A  ERRORERROR'
2018-10-27 00:13:46 [DEBUG   ] Got command RPT from MCS: ref #282213
2018-10-27 00:13:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:13:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282213  77 58418   826337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:13:46 [DEBUG   ] Got command RPT from MCS: ref #282214
2018-10-27 00:13:46 [DEBUG   ] summary = ERROR
2018-10-27 00:13:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282214  13 58418   826541 A  ERRORERROR'
2018-10-27 00:13:46 [DEBUG   ] Got command RPT from MCS: ref #282216
2018-10-27 00:13:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:13:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282216  77 58418   826745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:13:46 [DEBUG   ] Got command RPT from MCS: ref #282217
2018-10-27 00:13:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 00:13:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282217  12 58418   826949 A  ERRORB¦ff'
2018-10-27 00:13:58 [DEBUG   ] Got command BAM from MCS: ref #282222
2018-10-27 00:13:58 [INFO    ] Finished processing BAM request
2018-10-27 00:13:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:13:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282222   8 58418   838029 A  ERROR'
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:13:58 [DEBUG   ] spawn_process: at 2018-10-27 00:13:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:14:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-27 00:14:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:14:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:14:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 00:14:03 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:14:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:14:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:14:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:14:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:14:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:14:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:14:03 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-10-27 00:14:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-27 00:14:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 00:14:48 [DEBUG   ] Got command BAM from MCS: ref #282227
2018-10-27 00:14:48 [INFO    ] Finished processing BAM request
2018-10-27 00:14:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:14:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282227   8 58418   888033 A  ERROR'
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:14:48 [DEBUG   ] spawn_process: at 2018-10-27 00:14:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:15:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 00:15:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:15:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:15:03 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2018-10-27 00:15:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 00:15:03 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:15:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:15:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:15:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:15:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:15:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:15:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:15:03 [DEBUG   ] Finished updating board flags in 1.870 seconds
2018-10-27 00:15:06 [DEBUG   ] Got command BAM from MCS: ref #282228
2018-10-27 00:15:06 [INFO    ] Finished processing BAM request
2018-10-27 00:15:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:15:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282228   8 58418   906025 A  ERROR'
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:15:06 [DEBUG   ] spawn_process: at 2018-10-27 00:15:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:15:23 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-10-27 00:15:37 [DEBUG   ] Got command RPT from MCS: ref #282229
2018-10-27 00:15:37 [DEBUG   ] summary = ERROR
2018-10-27 00:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282229  13 58418   937553 A  ERRORERROR'
2018-10-27 00:15:37 [DEBUG   ] Got command RPT from MCS: ref #282230
2018-10-27 00:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282230  77 58418   937554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:15:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 00:15:59 [DEBUG   ] Got command BAM from MCS: ref #282246
2018-10-27 00:15:59 [INFO    ] Finished processing BAM request
2018-10-27 00:15:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:15:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282246   8 58418   959026 A  ERROR'
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 00:15:59 [DEBUG   ] spawn_process: at 2018-10-27 00:15:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 00:16:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-27 00:16:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:16:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 00:16:02 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:16:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:16:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:16:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:16:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:16:02 [WARNING ] (13, 1, 'bot')
2018-10-27 00:16:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:16:02 [DEBUG   ] Finished updating board flags in 1.171 seconds
2018-10-27 00:16:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:16:14 [DEBUG   ] Got command BAM from MCS: ref #282247
2018-10-27 00:16:14 [INFO    ] Finished processing BAM request
2018-10-27 00:16:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:16:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282247   8 58418   974030 A  ERROR'
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 00:16:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 00:16:14 [DEBUG   ] spawn_process: at 2018-10-27 00:16:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 00:16:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:16:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:16:58 [DEBUG   ] Got command BAM from MCS: ref #282249
2018-10-27 00:16:58 [INFO    ] Finished processing BAM request
2018-10-27 00:16:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:16:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282249   8 58418  1018026 A  ERROR'
2018-10-27 00:16:58 [DEBUG   ] Got command BAM from MCS: ref #282248
2018-10-27 00:16:58 [INFO    ] Finished processing BAM request
2018-10-27 00:16:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:16:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282248   8 58418  1018030 A  ERROR'
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:16:58 [DEBUG   ] spawn_process: at 2018-10-27 00:16:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:17:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 00:17:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:17:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:17:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 00:17:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 00:17:03 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:17:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:17:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 00:17:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:17:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:17:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:17:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:17:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:17:03 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-10-27 00:17:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:17:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 00:17:37 [DEBUG   ] Got command BAM from MCS: ref #282256
2018-10-27 00:17:37 [INFO    ] Finished processing BAM request
2018-10-27 00:17:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:17:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282256   8 58418  1057029 A  ERROR'
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:17:37 [DEBUG   ] spawn_process: at 2018-10-27 00:17:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:17:38 [DEBUG   ] Got command BAM from MCS: ref #282257
2018-10-27 00:17:38 [INFO    ] Finished processing BAM request
2018-10-27 00:17:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:17:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282257   8 58418  1058033 A  ERROR'
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 00:17:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 00:17:38 [DEBUG   ] spawn_process: at 2018-10-27 00:17:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 00:17:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:18:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:18:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 00:18:03 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:18:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:18:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:18:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:18:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:18:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:18:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:18:03 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-10-27 00:18:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 00:18:16 [DEBUG   ] Got command BAM from MCS: ref #282258
2018-10-27 00:18:16 [INFO    ] Finished processing BAM request
2018-10-27 00:18:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:18:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282258   8 58418  1096029 A  ERROR'
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:18:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:18:16 [DEBUG   ] spawn_process: at 2018-10-27 00:18:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:18:18 [DEBUG   ] Got command BAM from MCS: ref #282259
2018-10-27 00:18:18 [INFO    ] Finished processing BAM request
2018-10-27 00:18:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282259   8 58418  1098025 A  ERROR'
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 00:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 00:18:18 [DEBUG   ] spawn_process: at 2018-10-27 00:18:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 00:18:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:18:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 00:18:46 [DEBUG   ] Got command RPT from MCS: ref #282260
2018-10-27 00:18:46 [DEBUG   ] summary = ERROR
2018-10-27 00:18:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282260  13 58418  1126229 A  ERRORERROR'
2018-10-27 00:18:46 [DEBUG   ] Got command RPT from MCS: ref #282261
2018-10-27 00:18:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:18:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282261  77 58418  1126433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:18:46 [DEBUG   ] Got command RPT from MCS: ref #282262
2018-10-27 00:18:46 [DEBUG   ] summary = ERROR
2018-10-27 00:18:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282262  13 58418  1126625 A  ERRORERROR'
2018-10-27 00:18:46 [DEBUG   ] Got command RPT from MCS: ref #282263
2018-10-27 00:18:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:18:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282263  77 58418  1126829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:18:47 [DEBUG   ] Got command RPT from MCS: ref #282264
2018-10-27 00:18:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 00:18:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282264  12 58418  1127033 A  ERRORB¦ff'
2018-10-27 00:18:55 [DEBUG   ] Got command BAM from MCS: ref #282265
2018-10-27 00:18:55 [INFO    ] Finished processing BAM request
2018-10-27 00:18:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:18:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282265   8 58418  1135029 A  ERROR'
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:18:55 [DEBUG   ] spawn_process: at 2018-10-27 00:18:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:18:57 [DEBUG   ] Got command BAM from MCS: ref #282266
2018-10-27 00:18:57 [INFO    ] Finished processing BAM request
2018-10-27 00:18:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282266   8 58418  1137025 A  ERROR'
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 00:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 00:18:57 [DEBUG   ] spawn_process: at 2018-10-27 00:18:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 00:18:58 [DEBUG   ] Got command BAM from MCS: ref #282267
2018-10-27 00:18:58 [INFO    ] Finished processing BAM request
2018-10-27 00:18:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:18:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282267   8 58418  1138030 A  ERROR'
2018-10-27 00:18:58 [DEBUG   ] Got command BAM from MCS: ref #282268
2018-10-27 00:18:58 [INFO    ] Finished processing BAM request
2018-10-27 00:18:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:18:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282268   8 58418  1138034 A  ERROR'
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:18:58 [DEBUG   ] spawn_process: at 2018-10-27 00:18:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:19:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 00:19:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:19:03 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:19:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:19:03 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 00:19:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:19:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:19:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:19:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:19:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:19:03 [DEBUG   ] Finished updating board flags in 1.280 seconds
2018-10-27 00:19:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 00:19:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:19:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 00:20:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 00:20:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:20:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:20:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 00:20:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:20:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 00:20:04 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:20:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:20:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:20:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:20:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:20:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:20:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:20:04 [DEBUG   ] Finished updating board flags in 2.325 seconds
2018-10-27 00:20:06 [DEBUG   ] Got command BAM from MCS: ref #282275
2018-10-27 00:20:06 [INFO    ] Finished processing BAM request
2018-10-27 00:20:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:20:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282275   8 58418  1206034 A  ERROR'
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:20:06 [DEBUG   ] spawn_process: at 2018-10-27 00:20:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:20:09 [DEBUG   ] Got command BAM from MCS: ref #282276
2018-10-27 00:20:09 [INFO    ] Finished processing BAM request
2018-10-27 00:20:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282276   8 58418  1209026 A  ERROR'
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:20:09 [DEBUG   ] spawn_process: at 2018-10-27 00:20:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:20:24 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-10-27 00:20:37 [DEBUG   ] Got command RPT from MCS: ref #282277
2018-10-27 00:20:37 [DEBUG   ] summary = ERROR
2018-10-27 00:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282277  13 58418  1237561 A  ERRORERROR'
2018-10-27 00:20:37 [DEBUG   ] Got command RPT from MCS: ref #282278
2018-10-27 00:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282278  77 58418  1237562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:20:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:21:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 00:21:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 00:21:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:21:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:21:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-27 00:21:04 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:21:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:21:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:21:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:21:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:21:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:21:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:21:04 [DEBUG   ] Finished updating board flags in 2.468 seconds
2018-10-27 00:21:14 [DEBUG   ] Got command BAM from MCS: ref #282294
2018-10-27 00:21:14 [INFO    ] Finished processing BAM request
2018-10-27 00:21:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:21:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282294   8 58418  1274034 A  ERROR'
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 00:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 00:21:14 [DEBUG   ] spawn_process: at 2018-10-27 00:21:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 00:21:20 [DEBUG   ] Got command BAM from MCS: ref #282295
2018-10-27 00:21:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:21:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282295   8 58418  1280026 A  ERROR'
2018-10-27 00:21:20 [INFO    ] Finished processing BAM request
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:21:20 [DEBUG   ] spawn_process: at 2018-10-27 00:21:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:21:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 00:21:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 00:22:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:22:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:22:03 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:22:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:22:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:22:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:22:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:22:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:22:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:22:03 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-10-27 00:22:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 00:22:22 [DEBUG   ] Got command BAM from MCS: ref #282296
2018-10-27 00:22:22 [INFO    ] Finished processing BAM request
2018-10-27 00:22:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:22:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282296   8 58418  1342034 A  ERROR'
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:22:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:22:22 [DEBUG   ] spawn_process: at 2018-10-27 00:22:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:22:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:22:31 [DEBUG   ] Got command BAM from MCS: ref #282297
2018-10-27 00:22:31 [INFO    ] Finished processing BAM request
2018-10-27 00:22:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282297   8 58418  1351025 A  ERROR'
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:22:31 [DEBUG   ] spawn_process: at 2018-10-27 00:22:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:22:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:23:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:23:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:23:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 00:23:04 [DEBUG   ] Finished updating ant stats in 0.828 seconds
2018-10-27 00:23:04 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:23:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:23:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:23:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:23:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:23:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:23:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:23:04 [DEBUG   ] Finished updating board flags in 1.971 seconds
2018-10-27 00:23:24 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2018-10-27 00:23:30 [DEBUG   ] Got command BAM from MCS: ref #282304
2018-10-27 00:23:30 [INFO    ] Finished processing BAM request
2018-10-27 00:23:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282304   8 58418  1410029 A  ERROR'
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:23:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:23:30 [DEBUG   ] spawn_process: at 2018-10-27 00:23:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:23:42 [DEBUG   ] Got command BAM from MCS: ref #282305
2018-10-27 00:23:42 [INFO    ] Finished processing BAM request
2018-10-27 00:23:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:23:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282305   8 58418  1422033 A  ERROR'
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:23:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:23:42 [DEBUG   ] spawn_process: at 2018-10-27 00:23:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:23:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 00:23:46 [DEBUG   ] Got command RPT from MCS: ref #282306
2018-10-27 00:23:46 [DEBUG   ] summary = ERROR
2018-10-27 00:23:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282306  13 58418  1426305 A  ERRORERROR'
2018-10-27 00:23:46 [DEBUG   ] Got command RPT from MCS: ref #282307
2018-10-27 00:23:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:23:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282307  77 58418  1426509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:23:46 [DEBUG   ] Got command RPT from MCS: ref #282308
2018-10-27 00:23:46 [DEBUG   ] summary = ERROR
2018-10-27 00:23:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282308  13 58418  1426713 A  ERRORERROR'
2018-10-27 00:23:46 [DEBUG   ] Got command RPT from MCS: ref #282310
2018-10-27 00:23:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:23:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282310  77 58418  1426905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:23:47 [DEBUG   ] Got command RPT from MCS: ref #282311
2018-10-27 00:23:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 00:23:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282311  12 58418  1427109 A  ERRORB¦ff'
2018-10-27 00:24:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 00:24:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:24:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 00:24:03 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:24:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:24:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:24:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:24:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:24:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:24:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:24:03 [DEBUG   ] Finished updating board flags in 1.206 seconds
2018-10-27 00:24:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:24:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:24:38 [DEBUG   ] Got command BAM from MCS: ref #282316
2018-10-27 00:24:38 [INFO    ] Finished processing BAM request
2018-10-27 00:24:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:24:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282316   8 58418  1478025 A  ERROR'
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:24:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:24:38 [DEBUG   ] spawn_process: at 2018-10-27 00:24:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:24:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:24:53 [DEBUG   ] Got command BAM from MCS: ref #282317
2018-10-27 00:24:53 [INFO    ] Finished processing BAM request
2018-10-27 00:24:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:24:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282317   8 58418  1493029 A  ERROR'
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:24:53 [DEBUG   ] spawn_process: at 2018-10-27 00:24:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:25:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-10-27 00:25:03 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:25:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 00:25:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:25:03 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:25:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:25:03 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 00:25:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:25:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:25:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:25:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:25:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:25:03 [DEBUG   ] Finished updating board flags in 1.214 seconds
2018-10-27 00:25:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:25:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:25:37 [DEBUG   ] Got command RPT from MCS: ref #282318
2018-10-27 00:25:37 [DEBUG   ] summary = ERROR
2018-10-27 00:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282318  13 58418  1537553 A  ERRORERROR'
2018-10-27 00:25:37 [DEBUG   ] Got command RPT from MCS: ref #282319
2018-10-27 00:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282319  77 58418  1537554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:25:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:25:46 [DEBUG   ] Got command BAM from MCS: ref #282335
2018-10-27 00:25:46 [INFO    ] Finished processing BAM request
2018-10-27 00:25:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:25:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282335   8 58418  1546025 A  ERROR'
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 00:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 00:25:46 [DEBUG   ] spawn_process: at 2018-10-27 00:25:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 00:26:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-27 00:26:03 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:26:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:26:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 00:26:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:26:04 [DEBUG   ] Got command BAM from MCS: ref #282336
2018-10-27 00:26:04 [INFO    ] Finished processing BAM request
2018-10-27 00:26:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282336   8 58418  1564025 A  ERROR'
2018-10-27 00:26:04 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:26:04 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 00:26:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:26:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:26:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:26:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:26:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:26:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:26:04 [DEBUG   ] Finished updating board flags in 1.695 seconds
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 00:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 00:26:04 [DEBUG   ] spawn_process: at 2018-10-27 00:26:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 00:26:24 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-27 00:26:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 00:26:54 [DEBUG   ] Got command BAM from MCS: ref #282341
2018-10-27 00:26:54 [INFO    ] Finished processing BAM request
2018-10-27 00:26:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:26:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282341   8 58418  1614033 A  ERROR'
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:26:54 [DEBUG   ] spawn_process: at 2018-10-27 00:26:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:27:03 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:27:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:27:03 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:27:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:27:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 00:27:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:27:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:27:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:27:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:27:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:27:03 [DEBUG   ] Finished updating board flags in 1.089 seconds
2018-10-27 00:27:04 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-27 00:27:15 [DEBUG   ] Got command BAM from MCS: ref #282342
2018-10-27 00:27:15 [INFO    ] Finished processing BAM request
2018-10-27 00:27:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:27:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282342   8 58418  1635033 A  ERROR'
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:27:15 [DEBUG   ] spawn_process: at 2018-10-27 00:27:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:27:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:27:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:28:02 [DEBUG   ] Got command BAM from MCS: ref #282343
2018-10-27 00:28:02 [INFO    ] Finished processing BAM request
2018-10-27 00:28:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:28:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282343   8 58418  1682025 A  ERROR'
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:28:02 [DEBUG   ] spawn_process: at 2018-10-27 00:28:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:28:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-10-27 00:28:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-27 00:28:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:28:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 00:28:03 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:28:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:28:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:28:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:28:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:28:03 [WARNING ] (13, 1, 'bot')
2018-10-27 00:28:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:28:03 [DEBUG   ] Finished updating board flags in 0.992 seconds
2018-10-27 00:28:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:28:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:28:26 [DEBUG   ] Got command BAM from MCS: ref #282344
2018-10-27 00:28:26 [INFO    ] Finished processing BAM request
2018-10-27 00:28:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282344   8 58418  1706029 A  ERROR'
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:28:26 [DEBUG   ] spawn_process: at 2018-10-27 00:28:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:28:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:28:46 [DEBUG   ] Got command RPT from MCS: ref #282345
2018-10-27 00:28:46 [DEBUG   ] summary = ERROR
2018-10-27 00:28:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282345  13 58418  1726397 A  ERRORERROR'
2018-10-27 00:28:46 [DEBUG   ] Got command RPT from MCS: ref #282346
2018-10-27 00:28:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:28:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282346  77 58418  1726589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:28:46 [DEBUG   ] Got command RPT from MCS: ref #282347
2018-10-27 00:28:46 [DEBUG   ] summary = ERROR
2018-10-27 00:28:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282347  13 58418  1726793 A  ERRORERROR'
2018-10-27 00:28:46 [DEBUG   ] Got command RPT from MCS: ref #282348
2018-10-27 00:28:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:28:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282348  77 58418  1726997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:28:47 [DEBUG   ] Got command RPT from MCS: ref #282349
2018-10-27 00:28:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 00:28:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282349  12 58418  1727201 A  ERRORB¦ff'
2018-10-27 00:29:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 00:29:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 00:29:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:29:04 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:29:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:29:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 00:29:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:29:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:29:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:29:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:29:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:29:04 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-10-27 00:29:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 00:29:10 [DEBUG   ] Got command BAM from MCS: ref #282354
2018-10-27 00:29:10 [INFO    ] Finished processing BAM request
2018-10-27 00:29:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:29:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282354   8 58418  1750025 A  ERROR'
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:29:10 [DEBUG   ] spawn_process: at 2018-10-27 00:29:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:29:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:29:37 [DEBUG   ] Got command BAM from MCS: ref #282355
2018-10-27 00:29:37 [INFO    ] Finished processing BAM request
2018-10-27 00:29:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:29:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282355   8 58418  1777034 A  ERROR'
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 00:29:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 00:29:37 [DEBUG   ] spawn_process: at 2018-10-27 00:29:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 00:29:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:30:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 00:30:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:30:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 00:30:04 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:30:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:30:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 00:30:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:30:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:30:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:30:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:30:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:30:04 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-27 00:30:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:30:18 [DEBUG   ] Got command BAM from MCS: ref #282356
2018-10-27 00:30:18 [INFO    ] Finished processing BAM request
2018-10-27 00:30:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:30:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282356   8 58418  1818034 A  ERROR'
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:30:18 [DEBUG   ] spawn_process: at 2018-10-27 00:30:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:30:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:30:37 [DEBUG   ] Got command RPT from MCS: ref #282357
2018-10-27 00:30:37 [DEBUG   ] summary = ERROR
2018-10-27 00:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282357  13 58418  1837557 A  ERRORERROR'
2018-10-27 00:30:37 [DEBUG   ] Got command RPT from MCS: ref #282358
2018-10-27 00:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282358  77 58418  1837558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:30:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 00:30:48 [DEBUG   ] Got command BAM from MCS: ref #282374
2018-10-27 00:30:48 [INFO    ] Finished processing BAM request
2018-10-27 00:30:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282374   8 58418  1848026 A  ERROR'
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:30:48 [DEBUG   ] spawn_process: at 2018-10-27 00:30:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:31:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:31:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:31:04 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:31:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:31:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:31:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:31:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:31:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:31:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:31:04 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-10-27 00:31:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:31:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:31:26 [DEBUG   ] Got command BAM from MCS: ref #282375
2018-10-27 00:31:26 [INFO    ] Finished processing BAM request
2018-10-27 00:31:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:31:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282375   8 58418  1886034 A  ERROR'
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:31:26 [DEBUG   ] spawn_process: at 2018-10-27 00:31:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:31:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 00:31:59 [DEBUG   ] Got command BAM from MCS: ref #282376
2018-10-27 00:31:59 [INFO    ] Finished processing BAM request
2018-10-27 00:31:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:31:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282376   8 58418  1919026 A  ERROR'
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:31:59 [DEBUG   ] spawn_process: at 2018-10-27 00:31:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:32:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:32:04 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:32:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:32:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:32:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:32:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:32:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:32:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:32:04 [DEBUG   ] Finished updating board flags in 1.338 seconds
2018-10-27 00:32:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:32:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:32:34 [DEBUG   ] Got command BAM from MCS: ref #282381
2018-10-27 00:32:34 [INFO    ] Finished processing BAM request
2018-10-27 00:32:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:32:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282381   8 58418  1954025 A  ERROR'
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:32:34 [DEBUG   ] spawn_process: at 2018-10-27 00:32:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:32:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 00:33:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:33:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:33:04 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:33:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2018-10-27 00:33:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:33:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:33:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:33:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:33:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:33:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:33:04 [DEBUG   ] Finished updating board flags in 1.203 seconds
2018-10-27 00:33:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 00:33:10 [DEBUG   ] Got command BAM from MCS: ref #282382
2018-10-27 00:33:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:33:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282382   8 58418  1990270 A  ERROR'
2018-10-27 00:33:10 [INFO    ] Finished processing BAM request
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 00:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 00:33:10 [DEBUG   ] spawn_process: at 2018-10-27 00:33:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 00:33:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 00:33:42 [DEBUG   ] Got command BAM from MCS: ref #282385
2018-10-27 00:33:42 [INFO    ] Finished processing BAM request
2018-10-27 00:33:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:33:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282385   8 58418  2022026 A  ERROR'
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:33:42 [DEBUG   ] spawn_process: at 2018-10-27 00:33:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:33:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:33:46 [DEBUG   ] Got command RPT from MCS: ref #282386
2018-10-27 00:33:46 [DEBUG   ] summary = ERROR
2018-10-27 00:33:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282386  13 58418  2026477 A  ERRORERROR'
2018-10-27 00:33:46 [DEBUG   ] Got command RPT from MCS: ref #282387
2018-10-27 00:33:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:33:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282387  77 58418  2026681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:33:46 [DEBUG   ] Got command RPT from MCS: ref #282388
2018-10-27 00:33:46 [DEBUG   ] summary = ERROR
2018-10-27 00:33:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282388  13 58418  2026874 A  ERRORERROR'
2018-10-27 00:33:47 [DEBUG   ] Got command RPT from MCS: ref #282390
2018-10-27 00:33:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:33:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282390  77 58418  2027078 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:33:47 [DEBUG   ] Got command RPT from MCS: ref #282391
2018-10-27 00:33:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 00:33:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282391  12 58418  2027281 A  ERRORB¦ff'
2018-10-27 00:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-27 00:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 00:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 00:34:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:34:04 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:34:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:34:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:34:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:34:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:34:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:34:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:34:04 [DEBUG   ] Finished updating board flags in 1.182 seconds
2018-10-27 00:34:05 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-27 00:34:21 [DEBUG   ] Got command BAM from MCS: ref #282396
2018-10-27 00:34:21 [INFO    ] Finished processing BAM request
2018-10-27 00:34:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:34:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282396   8 58418  2061030 A  ERROR'
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:34:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:34:21 [DEBUG   ] spawn_process: at 2018-10-27 00:34:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:34:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 00:34:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 00:34:50 [DEBUG   ] Got command BAM from MCS: ref #282397
2018-10-27 00:34:50 [INFO    ] Finished processing BAM request
2018-10-27 00:34:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:34:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282397   8 58418  2090025 A  ERROR'
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:34:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:34:50 [DEBUG   ] spawn_process: at 2018-10-27 00:34:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:35:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:35:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:35:05 [DEBUG   ] Finished updating ant stats in 0.828 seconds
2018-10-27 00:35:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 00:35:05 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:35:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:35:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:35:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:35:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:35:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:35:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:35:05 [DEBUG   ] Finished updating board flags in 2.035 seconds
2018-10-27 00:35:25 [DEBUG   ] Finished updating ant stats in 0.775 seconds
2018-10-27 00:35:32 [DEBUG   ] Got command BAM from MCS: ref #282402
2018-10-27 00:35:32 [INFO    ] Finished processing BAM request
2018-10-27 00:35:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:35:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282402   8 58418  2132033 A  ERROR'
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:35:32 [DEBUG   ] spawn_process: at 2018-10-27 00:35:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:35:37 [DEBUG   ] Got command RPT from MCS: ref #282403
2018-10-27 00:35:37 [DEBUG   ] summary = ERROR
2018-10-27 00:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282403  13 58418  2137565 A  ERRORERROR'
2018-10-27 00:35:37 [DEBUG   ] Got command RPT from MCS: ref #282404
2018-10-27 00:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282404  77 58418  2137566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:35:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 00:35:58 [DEBUG   ] Got command BAM from MCS: ref #282420
2018-10-27 00:35:58 [INFO    ] Finished processing BAM request
2018-10-27 00:35:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282420   8 58418  2158029 A  ERROR'
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:35:58 [DEBUG   ] spawn_process: at 2018-10-27 00:35:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:36:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 00:36:04 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:36:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:36:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:36:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:36:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:36:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:36:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:36:04 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-10-27 00:36:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 00:36:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:36:43 [DEBUG   ] Got command BAM from MCS: ref #282421
2018-10-27 00:36:43 [INFO    ] Finished processing BAM request
2018-10-27 00:36:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282421   8 58418  2203029 A  ERROR'
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:36:43 [DEBUG   ] spawn_process: at 2018-10-27 00:36:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:36:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:37:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:37:04 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:37:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:37:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:37:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:37:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:37:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:37:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:37:04 [DEBUG   ] Finished updating board flags in 1.443 seconds
2018-10-27 00:37:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:37:06 [DEBUG   ] Got command BAM from MCS: ref #282422
2018-10-27 00:37:06 [INFO    ] Finished processing BAM request
2018-10-27 00:37:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:37:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282422   8 58418  2226025 A  ERROR'
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 00:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 00:37:06 [DEBUG   ] spawn_process: at 2018-10-27 00:37:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 00:37:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 00:37:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 00:37:54 [DEBUG   ] Got command BAM from MCS: ref #282423
2018-10-27 00:37:54 [INFO    ] Finished processing BAM request
2018-10-27 00:37:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:37:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282423   8 58418  2274033 A  ERROR'
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:37:54 [DEBUG   ] spawn_process: at 2018-10-27 00:37:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-10-27 00:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 00:38:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:38:04 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:38:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:38:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:38:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:38:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:38:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:38:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:38:04 [DEBUG   ] Finished updating board flags in 1.395 seconds
2018-10-27 00:38:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:38:14 [DEBUG   ] Got command BAM from MCS: ref #282428
2018-10-27 00:38:14 [INFO    ] Finished processing BAM request
2018-10-27 00:38:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:38:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282428   8 58418  2294033 A  ERROR'
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:38:14 [DEBUG   ] spawn_process: at 2018-10-27 00:38:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:38:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 00:38:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:38:46 [DEBUG   ] Got command RPT from MCS: ref #282429
2018-10-27 00:38:46 [DEBUG   ] summary = ERROR
2018-10-27 00:38:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282429  13 58418  2326565 A  ERRORERROR'
2018-10-27 00:38:46 [DEBUG   ] Got command RPT from MCS: ref #282430
2018-10-27 00:38:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:38:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282430  77 58418  2326769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:38:46 [DEBUG   ] Got command RPT from MCS: ref #282431
2018-10-27 00:38:46 [DEBUG   ] summary = ERROR
2018-10-27 00:38:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282431  13 58418  2326961 A  ERRORERROR'
2018-10-27 00:38:47 [DEBUG   ] Got command RPT from MCS: ref #282432
2018-10-27 00:38:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:38:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282432  77 58418  2327165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:38:47 [DEBUG   ] Got command RPT from MCS: ref #282433
2018-10-27 00:38:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 00:38:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282433  12 58418  2327369 A  ERRORB¦ff'
2018-10-27 00:38:58 [DEBUG   ] Got command BAM from MCS: ref #282434
2018-10-27 00:38:58 [INFO    ] Finished processing BAM request
2018-10-27 00:38:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:38:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282434   8 58418  2338029 A  ERROR'
2018-10-27 00:38:58 [DEBUG   ] Got command BAM from MCS: ref #282435
2018-10-27 00:38:58 [INFO    ] Finished processing BAM request
2018-10-27 00:38:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:38:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282435   8 58418  2338033 A  ERROR'
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 00:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 00:38:58 [DEBUG   ] spawn_process: at 2018-10-27 00:38:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 00:39:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:39:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:39:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:39:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 00:39:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:39:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:39:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:39:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:39:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:39:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:39:05 [DEBUG   ] Finished updating board flags in 1.672 seconds
2018-10-27 00:39:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 00:39:29 [DEBUG   ] Got command BAM from MCS: ref #282438
2018-10-27 00:39:29 [INFO    ] Finished processing BAM request
2018-10-27 00:39:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282438   8 58418  2369037 A  ERROR'
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:39:29 [DEBUG   ] spawn_process: at 2018-10-27 00:39:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:39:31 [DEBUG   ] Got command BAM from MCS: ref #282439
2018-10-27 00:39:31 [INFO    ] Finished processing BAM request
2018-10-27 00:39:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:39:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282439   8 58418  2371033 A  ERROR'
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:39:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:39:31 [DEBUG   ] spawn_process: at 2018-10-27 00:39:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:39:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 00:39:59 [DEBUG   ] Got command BAM from MCS: ref #282440
2018-10-27 00:39:59 [INFO    ] Finished processing BAM request
2018-10-27 00:39:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282440   8 58418  2399029 A  ERROR'
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:39:59 [DEBUG   ] spawn_process: at 2018-10-27 00:39:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:40:04 [DEBUG   ] Got command BAM from MCS: ref #282441
2018-10-27 00:40:04 [INFO    ] Finished processing BAM request
2018-10-27 00:40:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282441   8 58418  2404061 A  ERROR'
2018-10-27 00:40:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:40:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 00:40:04 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:40:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:40:04 [DEBUG   ] spawn_process: at 2018-10-27 00:40:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:40:04 [DEBUG   ] spawn_process: at 2018-10-27 00:40:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:40:04 [DEBUG   ] spawn_process: at 2018-10-27 00:40:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:40:04 [DEBUG   ] spawn_process: at 2018-10-27 00:40:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:40:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 00:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:40:04 [DEBUG   ] spawn_process: at 2018-10-27 00:40:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:40:04 [DEBUG   ] spawn_process: at 2018-10-27 00:40:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:40:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:40:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:40:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:40:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:40:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:40:04 [DEBUG   ] Finished updating board flags in 1.181 seconds
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:40:05 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:40:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:40:05 [DEBUG   ] spawn_process: at 2018-10-27 00:40:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:40:25 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-27 00:40:29 [DEBUG   ] Got command BAM from MCS: ref #282442
2018-10-27 00:40:29 [INFO    ] Finished processing BAM request
2018-10-27 00:40:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:40:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282442   8 58418  2429025 A  ERROR'
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:40:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:40:29 [DEBUG   ] spawn_process: at 2018-10-27 00:40:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:40:37 [DEBUG   ] Got command BAM from MCS: ref #282443
2018-10-27 00:40:37 [INFO    ] Finished processing BAM request
2018-10-27 00:40:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282443   8 58418  2437033 A  ERROR'
2018-10-27 00:40:37 [DEBUG   ] Got command RPT from MCS: ref #282444
2018-10-27 00:40:37 [DEBUG   ] summary = ERROR
2018-10-27 00:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282444  13 58418  2437561 A  ERRORERROR'
2018-10-27 00:40:37 [DEBUG   ] Got command RPT from MCS: ref #282445
2018-10-27 00:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282445  77 58418  2437562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:40:37 [DEBUG   ] spawn_process: at 2018-10-27 00:40:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:40:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:40:58 [DEBUG   ] Got command BAM from MCS: ref #282461
2018-10-27 00:40:58 [INFO    ] Finished processing BAM request
2018-10-27 00:40:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282461   8 58418  2458025 A  ERROR'
2018-10-27 00:40:58 [DEBUG   ] Got command BAM from MCS: ref #282462
2018-10-27 00:40:58 [INFO    ] Finished processing BAM request
2018-10-27 00:40:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282462   8 58418  2458029 A  ERROR'
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:40:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:40:58 [DEBUG   ] spawn_process: at 2018-10-27 00:40:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:41:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:41:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:41:04 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:41:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:41:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:41:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:41:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:41:04 [WARNING ] (13, 1, 'bot')
2018-10-27 00:41:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:41:04 [DEBUG   ] Finished updating board flags in 0.962 seconds
2018-10-27 00:41:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:41:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 00:41:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 00:42:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-10-27 00:42:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-10-27 00:42:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:42:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:42:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 00:42:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:42:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:42:05 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 00:42:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:42:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:42:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:42:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:42:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:42:05 [DEBUG   ] Finished updating board flags in 1.345 seconds
2018-10-27 00:42:06 [DEBUG   ] Got command BAM from MCS: ref #282469
2018-10-27 00:42:06 [INFO    ] Finished processing BAM request
2018-10-27 00:42:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:42:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282469   8 58418  2526025 A  ERROR'
2018-10-27 00:42:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:42:06 [DEBUG   ] spawn_process: at 2018-10-27 00:42:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:42:09 [DEBUG   ] Got command BAM from MCS: ref #282470
2018-10-27 00:42:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:42:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282470   8 58418  2529049 A  ERROR'
2018-10-27 00:42:09 [INFO    ] Finished processing BAM request
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:42:09 [DEBUG   ] spawn_process: at 2018-10-27 00:42:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:42:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 00:42:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 00:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-10-27 00:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-27 00:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:43:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:43:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:43:05 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:43:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2018-10-27 00:43:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:43:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:43:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:43:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:43:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:43:05 [DEBUG   ] Finished updating board flags in 1.239 seconds
2018-10-27 00:43:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 00:43:14 [DEBUG   ] Got command BAM from MCS: ref #282471
2018-10-27 00:43:14 [INFO    ] Finished processing BAM request
2018-10-27 00:43:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:43:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282471   8 58418  2594033 A  ERROR'
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 00:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 00:43:14 [DEBUG   ] spawn_process: at 2018-10-27 00:43:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 00:43:20 [DEBUG   ] Got command BAM from MCS: ref #282472
2018-10-27 00:43:20 [INFO    ] Finished processing BAM request
2018-10-27 00:43:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282472   8 58418  2600025 A  ERROR'
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:43:20 [DEBUG   ] spawn_process: at 2018-10-27 00:43:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:43:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-27 00:43:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:43:46 [DEBUG   ] Got command RPT from MCS: ref #282475
2018-10-27 00:43:46 [DEBUG   ] summary = ERROR
2018-10-27 00:43:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282475  13 58418  2626653 A  ERRORERROR'
2018-10-27 00:43:46 [DEBUG   ] Got command RPT from MCS: ref #282476
2018-10-27 00:43:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:43:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282476  77 58418  2626845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:43:47 [DEBUG   ] Got command RPT from MCS: ref #282477
2018-10-27 00:43:47 [DEBUG   ] summary = ERROR
2018-10-27 00:43:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282477  13 58418  2627049 A  ERRORERROR'
2018-10-27 00:43:47 [DEBUG   ] Got command RPT from MCS: ref #282479
2018-10-27 00:43:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:43:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282479  77 58418  2627253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:43:47 [DEBUG   ] Got command RPT from MCS: ref #282480
2018-10-27 00:43:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 00:43:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282480  12 58418  2627457 A  ERRORB¦ff'
2018-10-27 00:44:04 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:44:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:44:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:44:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2018-10-27 00:44:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:44:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:44:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:44:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:44:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:44:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:44:05 [DEBUG   ] Finished updating board flags in 1.128 seconds
2018-10-27 00:44:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:44:22 [DEBUG   ] Got command BAM from MCS: ref #282489
2018-10-27 00:44:22 [INFO    ] Finished processing BAM request
2018-10-27 00:44:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:44:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282489   8 58418  2662033 A  ERROR'
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:44:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:44:22 [DEBUG   ] spawn_process: at 2018-10-27 00:44:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:44:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-27 00:44:31 [DEBUG   ] Got command BAM from MCS: ref #282490
2018-10-27 00:44:31 [INFO    ] Finished processing BAM request
2018-10-27 00:44:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:44:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282490   8 58418  2671033 A  ERROR'
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:44:31 [DEBUG   ] spawn_process: at 2018-10-27 00:44:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:44:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:45:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:45:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 00:45:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:45:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:45:05 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 00:45:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:45:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:45:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:45:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:45:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:45:05 [DEBUG   ] Finished updating board flags in 1.215 seconds
2018-10-27 00:45:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:45:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 00:45:30 [DEBUG   ] Got command BAM from MCS: ref #282491
2018-10-27 00:45:30 [INFO    ] Finished processing BAM request
2018-10-27 00:45:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:45:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282491   8 58418  2730029 A  ERROR'
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:45:30 [DEBUG   ] spawn_process: at 2018-10-27 00:45:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:45:37 [DEBUG   ] Got command RPT from MCS: ref #282492
2018-10-27 00:45:37 [DEBUG   ] summary = ERROR
2018-10-27 00:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282492  13 58418  2737565 A  ERRORERROR'
2018-10-27 00:45:37 [DEBUG   ] Got command RPT from MCS: ref #282493
2018-10-27 00:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282493  77 58418  2737566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:45:42 [DEBUG   ] Got command BAM from MCS: ref #282509
2018-10-27 00:45:42 [INFO    ] Finished processing BAM request
2018-10-27 00:45:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:45:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282509   8 58418  2742033 A  ERROR'
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 00:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 00:45:42 [DEBUG   ] spawn_process: at 2018-10-27 00:45:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 00:45:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:46:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:46:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 00:46:06 [DEBUG   ] Finished updating ant stats in 0.829 seconds
2018-10-27 00:46:06 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:46:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:46:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:46:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:46:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:46:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:46:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:46:06 [DEBUG   ] Finished updating board flags in 2.036 seconds
2018-10-27 00:46:26 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2018-10-27 00:46:38 [DEBUG   ] Got command BAM from MCS: ref #282510
2018-10-27 00:46:38 [INFO    ] Finished processing BAM request
2018-10-27 00:46:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282510   8 58418  2798029 A  ERROR'
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:46:38 [DEBUG   ] spawn_process: at 2018-10-27 00:46:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:46:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:46:53 [DEBUG   ] Got command BAM from MCS: ref #282511
2018-10-27 00:46:53 [INFO    ] Finished processing BAM request
2018-10-27 00:46:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:46:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282511   8 58418  2813025 A  ERROR'
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:46:53 [DEBUG   ] spawn_process: at 2018-10-27 00:46:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:47:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-27 00:47:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-27 00:47:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:47:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 00:47:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:47:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-27 00:47:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:47:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:47:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:47:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:47:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:47:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:47:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:47:05 [DEBUG   ] Finished updating board flags in 1.444 seconds
2018-10-27 00:47:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:47:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:47:46 [DEBUG   ] Got command BAM from MCS: ref #282516
2018-10-27 00:47:46 [INFO    ] Finished processing BAM request
2018-10-27 00:47:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:47:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282516   8 58418  2866029 A  ERROR'
2018-10-27 00:47:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:47:46 [DEBUG   ] spawn_process: at 2018-10-27 00:47:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:48:04 [DEBUG   ] Got command BAM from MCS: ref #282517
2018-10-27 00:48:04 [INFO    ] Finished processing BAM request
2018-10-27 00:48:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:48:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282517   8 58418  2884025 A  ERROR'
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:48:04 [DEBUG   ] spawn_process: at 2018-10-27 00:48:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:48:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:48:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 00:48:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:48:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:48:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:48:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:48:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:48:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:48:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:48:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:48:05 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-27 00:48:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 00:48:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:48:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:48:46 [DEBUG   ] Got command RPT from MCS: ref #282518
2018-10-27 00:48:46 [DEBUG   ] summary = ERROR
2018-10-27 00:48:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282518  13 58418  2926737 A  ERRORERROR'
2018-10-27 00:48:46 [DEBUG   ] Got command RPT from MCS: ref #282519
2018-10-27 00:48:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:48:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282519  77 58418  2926941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:48:47 [DEBUG   ] Got command RPT from MCS: ref #282520
2018-10-27 00:48:47 [DEBUG   ] summary = ERROR
2018-10-27 00:48:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282520  13 58418  2927133 A  ERRORERROR'
2018-10-27 00:48:47 [DEBUG   ] Got command RPT from MCS: ref #282521
2018-10-27 00:48:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:48:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282521  77 58418  2927337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:48:47 [DEBUG   ] Got command RPT from MCS: ref #282522
2018-10-27 00:48:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 00:48:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282522  12 58418  2927541 A  ERRORB¥ff'
2018-10-27 00:48:54 [DEBUG   ] Got command BAM from MCS: ref #282523
2018-10-27 00:48:54 [INFO    ] Finished processing BAM request
2018-10-27 00:48:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:48:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282523   8 58418  2934025 A  ERROR'
2018-10-27 00:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 00:48:54 [DEBUG   ] spawn_process: at 2018-10-27 00:48:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 00:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 00:48:55 [DEBUG   ] spawn_process: at 2018-10-27 00:48:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 00:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 00:49:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:49:06 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:49:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 00:49:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:49:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2018-10-27 00:49:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:49:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:49:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:49:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:49:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:49:06 [DEBUG   ] Finished updating board flags in 1.878 seconds
2018-10-27 00:49:15 [DEBUG   ] Got command BAM from MCS: ref #282524
2018-10-27 00:49:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:49:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282524   8 58418  2955182 A  ERROR'
2018-10-27 00:49:15 [INFO    ] Finished processing BAM request
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:49:15 [DEBUG   ] spawn_process: at 2018-10-27 00:49:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:49:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 00:49:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 00:50:02 [DEBUG   ] Got command BAM from MCS: ref #282525
2018-10-27 00:50:02 [INFO    ] Finished processing BAM request
2018-10-27 00:50:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282525   8 58418  3002034 A  ERROR'
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:50:02 [DEBUG   ] spawn_process: at 2018-10-27 00:50:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-27 00:50:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 00:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:50:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:50:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:50:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 00:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 00:50:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:50:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:50:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:50:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:50:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:50:05 [DEBUG   ] Finished updating board flags in 1.264 seconds
2018-10-27 00:50:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 00:50:26 [DEBUG   ] Got command BAM from MCS: ref #282530
2018-10-27 00:50:26 [INFO    ] Finished processing BAM request
2018-10-27 00:50:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:50:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282530   8 58418  3026030 A  ERROR'
2018-10-27 00:50:26 [DEBUG   ] Finished updating ant stats in 0.383 seconds
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:50:26 [DEBUG   ] spawn_process: at 2018-10-27 00:50:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:50:37 [DEBUG   ] Got command RPT from MCS: ref #282531
2018-10-27 00:50:37 [DEBUG   ] summary = ERROR
2018-10-27 00:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282531  13 58418  3037562 A  ERRORERROR'
2018-10-27 00:50:37 [DEBUG   ] Got command RPT from MCS: ref #282532
2018-10-27 00:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282532  77 58418  3037562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:50:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 00:51:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:51:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 00:51:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:51:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-27 00:51:07 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2018-10-27 00:51:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:51:07 [WARNING ] (13, 1, 'bot')
2018-10-27 00:51:07 [WARNING ] (13, 1, 'bot')
2018-10-27 00:51:07 [WARNING ] (13, 1, 'bot')
2018-10-27 00:51:07 [WARNING ] (13, 1, 'bot')
2018-10-27 00:51:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:51:07 [DEBUG   ] Finished updating board flags in 2.896 seconds
2018-10-27 00:51:10 [DEBUG   ] Got command BAM from MCS: ref #282548
2018-10-27 00:51:10 [INFO    ] Finished processing BAM request
2018-10-27 00:51:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:51:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282548   8 58418  3070026 A  ERROR'
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:51:10 [DEBUG   ] spawn_process: at 2018-10-27 00:51:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:51:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-27 00:51:37 [DEBUG   ] Got command BAM from MCS: ref #282549
2018-10-27 00:51:37 [INFO    ] Finished processing BAM request
2018-10-27 00:51:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:51:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282549   8 58418  3097029 A  ERROR'
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:51:37 [DEBUG   ] spawn_process: at 2018-10-27 00:51:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:51:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:52:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:52:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:52:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 00:52:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:52:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:52:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:52:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:52:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:52:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:52:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:52:05 [DEBUG   ] Finished updating board flags in 1.081 seconds
2018-10-27 00:52:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 00:52:18 [DEBUG   ] Got command BAM from MCS: ref #282550
2018-10-27 00:52:18 [INFO    ] Finished processing BAM request
2018-10-27 00:52:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:52:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282550   8 58418  3138029 A  ERROR'
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:52:18 [DEBUG   ] spawn_process: at 2018-10-27 00:52:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:52:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 00:52:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 00:52:48 [DEBUG   ] Got command BAM from MCS: ref #282551
2018-10-27 00:52:48 [INFO    ] Finished processing BAM request
2018-10-27 00:52:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:52:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282551   8 58418  3168033 A  ERROR'
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:52:48 [DEBUG   ] spawn_process: at 2018-10-27 00:52:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 00:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 00:53:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 00:53:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:53:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:53:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:53:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:53:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:53:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:53:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:53:05 [DEBUG   ] Finished updating board flags in 1.021 seconds
2018-10-27 00:53:07 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-27 00:53:26 [DEBUG   ] Got command BAM from MCS: ref #282558
2018-10-27 00:53:26 [INFO    ] Finished processing BAM request
2018-10-27 00:53:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282558   8 58418  3206029 A  ERROR'
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:53:26 [DEBUG   ] spawn_process: at 2018-10-27 00:53:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:53:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 00:53:46 [DEBUG   ] Got command RPT from MCS: ref #282559
2018-10-27 00:53:46 [DEBUG   ] summary = ERROR
2018-10-27 00:53:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282559  13 58418  3226821 A  ERRORERROR'
2018-10-27 00:53:47 [DEBUG   ] Got command RPT from MCS: ref #282560
2018-10-27 00:53:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:53:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282560  77 58418  3227025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:53:47 [DEBUG   ] Got command RPT from MCS: ref #282561
2018-10-27 00:53:47 [DEBUG   ] summary = ERROR
2018-10-27 00:53:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282561  13 58418  3227218 A  ERRORERROR'
2018-10-27 00:53:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:53:47 [DEBUG   ] Got command RPT from MCS: ref #282563
2018-10-27 00:53:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:53:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282563  77 58418  3227421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:53:47 [DEBUG   ] Got command RPT from MCS: ref #282565
2018-10-27 00:53:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 00:53:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282565  12 58418  3227625 A  ERRORB¥ff'
2018-10-27 00:53:59 [DEBUG   ] Got command BAM from MCS: ref #282569
2018-10-27 00:53:59 [INFO    ] Finished processing BAM request
2018-10-27 00:53:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:53:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282569   8 58418  3239029 A  ERROR'
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:53:59 [DEBUG   ] spawn_process: at 2018-10-27 00:53:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:54:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:54:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-10-27 00:54:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 00:54:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:54:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:54:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:54:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:54:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:54:05 [WARNING ] (13, 1, 'bot')
2018-10-27 00:54:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:54:05 [DEBUG   ] Finished updating board flags in 0.972 seconds
2018-10-27 00:54:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:54:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:54:34 [DEBUG   ] Got command BAM from MCS: ref #282570
2018-10-27 00:54:34 [INFO    ] Finished processing BAM request
2018-10-27 00:54:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:54:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282570   8 58418  3274033 A  ERROR'
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 00:54:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 00:54:35 [DEBUG   ] spawn_process: at 2018-10-27 00:54:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 00:54:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 00:55:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-10-27 00:55:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:55:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:55:06 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:55:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:55:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:55:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:55:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:55:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:55:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:55:06 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-10-27 00:55:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:55:10 [DEBUG   ] Got command BAM from MCS: ref #282571
2018-10-27 00:55:10 [INFO    ] Finished processing BAM request
2018-10-27 00:55:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:55:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282571   8 58418  3310333 A  ERROR'
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:55:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:55:10 [DEBUG   ] spawn_process: at 2018-10-27 00:55:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:55:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:55:37 [DEBUG   ] Got command RPT from MCS: ref #282572
2018-10-27 00:55:37 [DEBUG   ] summary = ERROR
2018-10-27 00:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282572  13 58418  3337561 A  ERRORERROR'
2018-10-27 00:55:37 [DEBUG   ] Got command RPT from MCS: ref #282573
2018-10-27 00:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282573  77 58418  3337562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:55:42 [DEBUG   ] Got command BAM from MCS: ref #282589
2018-10-27 00:55:42 [INFO    ] Finished processing BAM request
2018-10-27 00:55:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:55:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282589   8 58418  3342029 A  ERROR'
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:55:42 [DEBUG   ] spawn_process: at 2018-10-27 00:55:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:55:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 00:56:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-27 00:56:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 00:56:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:56:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:56:06 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:56:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:56:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 00:56:06 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 00:56:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:56:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:56:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:56:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:56:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:56:06 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-10-27 00:56:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:56:21 [DEBUG   ] Got command BAM from MCS: ref #282594
2018-10-27 00:56:21 [INFO    ] Finished processing BAM request
2018-10-27 00:56:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:56:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282594   8 58418  3381029 A  ERROR'
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:56:21 [DEBUG   ] spawn_process: at 2018-10-27 00:56:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:56:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:56:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 00:56:50 [DEBUG   ] Got command BAM from MCS: ref #282595
2018-10-27 00:56:50 [INFO    ] Finished processing BAM request
2018-10-27 00:56:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:56:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282595   8 58418  3410029 A  ERROR'
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 00:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 00:56:50 [DEBUG   ] spawn_process: at 2018-10-27 00:56:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 00:57:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 00:57:06 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:57:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:57:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 00:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 00:57:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:57:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:57:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:57:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:57:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:57:06 [DEBUG   ] Finished updating board flags in 1.205 seconds
2018-10-27 00:57:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-27 00:57:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:57:32 [DEBUG   ] Got command BAM from MCS: ref #282596
2018-10-27 00:57:32 [INFO    ] Finished processing BAM request
2018-10-27 00:57:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:57:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282596   8 58418  3452025 A  ERROR'
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:57:32 [DEBUG   ] spawn_process: at 2018-10-27 00:57:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:57:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 00:57:58 [DEBUG   ] Got command BAM from MCS: ref #282597
2018-10-27 00:57:58 [INFO    ] Finished processing BAM request
2018-10-27 00:57:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:57:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282597   8 58418  3478025 A  ERROR'
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:57:58 [DEBUG   ] spawn_process: at 2018-10-27 00:57:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:58:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:58:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:58:06 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:58:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:58:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:58:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:58:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:58:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:58:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:58:06 [DEBUG   ] Finished updating board flags in 1.245 seconds
2018-10-27 00:58:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:58:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:58:43 [DEBUG   ] Got command BAM from MCS: ref #282598
2018-10-27 00:58:43 [INFO    ] Finished processing BAM request
2018-10-27 00:58:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:58:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282598   8 58418  3523029 A  ERROR'
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 00:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 00:58:43 [DEBUG   ] spawn_process: at 2018-10-27 00:58:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 00:58:46 [DEBUG   ] Got command RPT from MCS: ref #282599
2018-10-27 00:58:46 [DEBUG   ] summary = ERROR
2018-10-27 00:58:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282599  13 58418  3526902 A  ERRORERROR'
2018-10-27 00:58:47 [DEBUG   ] Got command RPT from MCS: ref #282600
2018-10-27 00:58:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:58:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282600  77 58418  3527105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:58:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:58:47 [DEBUG   ] Got command RPT from MCS: ref #282601
2018-10-27 00:58:47 [DEBUG   ] summary = ERROR
2018-10-27 00:58:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282601  13 58418  3527309 A  ERRORERROR'
2018-10-27 00:58:47 [DEBUG   ] Got command RPT from MCS: ref #282602
2018-10-27 00:58:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 00:58:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282602  77 58418  3527513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 00:58:47 [DEBUG   ] Got command RPT from MCS: ref #282603
2018-10-27 00:58:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 00:58:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282603  12 58418  3527705 A  ERRORB¥ff'
2018-10-27 00:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-27 00:59:05 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-27 00:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 00:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-27 00:59:05 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 00:59:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 00:59:06 [DEBUG   ] Got command BAM from MCS: ref #282608
2018-10-27 00:59:06 [INFO    ] Finished processing BAM request
2018-10-27 00:59:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282608   8 58418  3546033 A  ERROR'
2018-10-27 00:59:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 00:59:06 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 00:59:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 00:59:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 00:59:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:59:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:59:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:59:06 [WARNING ] (13, 1, 'bot')
2018-10-27 00:59:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 00:59:06 [DEBUG   ] Finished updating board flags in 1.180 seconds
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 00:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 00:59:06 [DEBUG   ] spawn_process: at 2018-10-27 00:59:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 00:59:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 00:59:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:59:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 00:59:54 [DEBUG   ] Got command BAM from MCS: ref #282609
2018-10-27 00:59:54 [INFO    ] Finished processing BAM request
2018-10-27 00:59:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 00:59:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282609   8 58418  3594029 A  ERROR'
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 00:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 00:59:54 [DEBUG   ] spawn_process: at 2018-10-27 00:59:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:00:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-27 01:00:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:00:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 01:00:07 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2018-10-27 01:00:07 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:00:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 01:00:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:00:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:00:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:00:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:00:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:00:07 [DEBUG   ] Finished updating board flags in 2.053 seconds
2018-10-27 01:00:14 [DEBUG   ] Got command BAM from MCS: ref #282610
2018-10-27 01:00:14 [INFO    ] Finished processing BAM request
2018-10-27 01:00:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:00:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282610   8 58418  3614029 A  ERROR'
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:00:14 [DEBUG   ] spawn_process: at 2018-10-27 01:00:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:00:27 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-10-27 01:00:37 [DEBUG   ] Got command RPT from MCS: ref #282611
2018-10-27 01:00:37 [DEBUG   ] summary = ERROR
2018-10-27 01:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282611  13 58418  3637569 A  ERRORERROR'
2018-10-27 01:00:37 [DEBUG   ] Got command RPT from MCS: ref #282612
2018-10-27 01:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282612  77 58418  3637570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:00:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 01:00:58 [DEBUG   ] Got command BAM from MCS: ref #282629
2018-10-27 01:00:58 [INFO    ] Finished processing BAM request
2018-10-27 01:00:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282629   8 58418  3658033 A  ERROR'
2018-10-27 01:00:58 [DEBUG   ] Got command BAM from MCS: ref #282628
2018-10-27 01:00:58 [INFO    ] Finished processing BAM request
2018-10-27 01:00:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282628   8 58418  3658037 A  ERROR'
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:00:58 [DEBUG   ] spawn_process: at 2018-10-27 01:00:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-27 01:01:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-27 01:01:06 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:01:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 01:01:06 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 01:01:06 [WARNING ] (13, 1, 'bot')
2018-10-27 01:01:06 [WARNING ] (13, 1, 'bot')
2018-10-27 01:01:06 [WARNING ] (13, 1, 'bot')
2018-10-27 01:01:06 [WARNING ] (13, 1, 'bot')
2018-10-27 01:01:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:01:06 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-10-27 01:01:07 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-27 01:01:23 [DEBUG   ] Got command BAM from MCS: ref #282632
2018-10-27 01:01:23 [INFO    ] Finished processing BAM request
2018-10-27 01:01:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:01:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282632   8 58418  3683029 A  ERROR'
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:01:23 [DEBUG   ] spawn_process: at 2018-10-27 01:01:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:01:27 [DEBUG   ] Got command BAM from MCS: ref #282633
2018-10-27 01:01:27 [INFO    ] Finished processing BAM request
2018-10-27 01:01:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:01:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282633   8 58418  3687025 A  ERROR'
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:01:27 [DEBUG   ] spawn_process: at 2018-10-27 01:01:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:01:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 01:01:48 [DEBUG   ] Got command BAM from MCS: ref #282634
2018-10-27 01:01:48 [INFO    ] Finished processing BAM request
2018-10-27 01:01:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:01:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282634   8 58418  3708029 A  ERROR'
2018-10-27 01:01:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 01:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 01:01:48 [DEBUG   ] spawn_process: at 2018-10-27 01:01:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 01:01:56 [DEBUG   ] Got command BAM from MCS: ref #282635
2018-10-27 01:01:56 [INFO    ] Finished processing BAM request
2018-10-27 01:01:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:01:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282635   8 58418  3716029 A  ERROR'
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:01:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:01:56 [DEBUG   ] spawn_process: at 2018-10-27 01:01:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:02:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-10-27 01:02:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 01:02:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 01:02:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:02:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-27 01:02:06 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:02:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-27 01:02:06 [WARNING ] (13, 1, 'bot')
2018-10-27 01:02:06 [WARNING ] (13, 1, 'bot')
2018-10-27 01:02:06 [WARNING ] (13, 1, 'bot')
2018-10-27 01:02:06 [WARNING ] (13, 1, 'bot')
2018-10-27 01:02:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:02:06 [DEBUG   ] Finished updating board flags in 1.195 seconds
2018-10-27 01:02:08 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-27 01:02:13 [DEBUG   ] Got command BAM from MCS: ref #282640
2018-10-27 01:02:13 [INFO    ] Finished processing BAM request
2018-10-27 01:02:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:02:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282640   8 58418  3733029 A  ERROR'
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:02:13 [DEBUG   ] spawn_process: at 2018-10-27 01:02:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:02:25 [DEBUG   ] Got command BAM from MCS: ref #282641
2018-10-27 01:02:25 [INFO    ] Finished processing BAM request
2018-10-27 01:02:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:02:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282641   8 58418  3745025 A  ERROR'
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:02:25 [DEBUG   ] spawn_process: at 2018-10-27 01:02:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:02:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 01:02:38 [DEBUG   ] Got command BAM from MCS: ref #282642
2018-10-27 01:02:38 [INFO    ] Finished processing BAM request
2018-10-27 01:02:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:02:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282642   8 58418  3758029 A  ERROR'
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:02:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:02:38 [DEBUG   ] spawn_process: at 2018-10-27 01:02:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:02:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 01:02:54 [DEBUG   ] Got command BAM from MCS: ref #282643
2018-10-27 01:02:54 [INFO    ] Finished processing BAM request
2018-10-27 01:02:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:02:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282643   8 58418  3774025 A  ERROR'
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:02:54 [DEBUG   ] spawn_process: at 2018-10-27 01:02:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:02:58 [DEBUG   ] Got command BAM from MCS: ref #282644
2018-10-27 01:02:58 [INFO    ] Finished processing BAM request
2018-10-27 01:02:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:02:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282644   8 58418  3778025 A  ERROR'
2018-10-27 01:02:58 [DEBUG   ] Got command BAM from MCS: ref #282645
2018-10-27 01:02:58 [INFO    ] Finished processing BAM request
2018-10-27 01:02:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:02:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282645   8 58418  3778029 A  ERROR'
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:02:58 [DEBUG   ] spawn_process: at 2018-10-27 01:02:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:03:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-27 01:03:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:03:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 01:03:06 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:03:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 01:03:06 [WARNING ] (13, 1, 'bot')
2018-10-27 01:03:06 [WARNING ] (13, 1, 'bot')
2018-10-27 01:03:06 [WARNING ] (13, 1, 'bot')
2018-10-27 01:03:06 [WARNING ] (13, 1, 'bot')
2018-10-27 01:03:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:03:06 [DEBUG   ] Finished updating board flags in 1.020 seconds
2018-10-27 01:03:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:03:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:03:46 [DEBUG   ] Got command RPT from MCS: ref #282650
2018-10-27 01:03:46 [DEBUG   ] summary = ERROR
2018-10-27 01:03:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282650  13 58418  3826997 A  ERRORERROR'
2018-10-27 01:03:47 [DEBUG   ] Got command RPT from MCS: ref #282651
2018-10-27 01:03:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:03:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282651  77 58418  3827189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:03:47 [DEBUG   ] Got command RPT from MCS: ref #282652
2018-10-27 01:03:47 [DEBUG   ] summary = ERROR
2018-10-27 01:03:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282652  13 58418  3827397 A  ERRORERROR'
2018-10-27 01:03:47 [DEBUG   ] Got command RPT from MCS: ref #282654
2018-10-27 01:03:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:03:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282654  77 58418  3827589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:03:47 [DEBUG   ] Got command RPT from MCS: ref #282655
2018-10-27 01:03:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 01:03:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282655  12 58418  3827793 A  ERRORB¥ff'
2018-10-27 01:03:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 01:04:06 [DEBUG   ] Got command BAM from MCS: ref #282660
2018-10-27 01:04:06 [INFO    ] Finished processing BAM request
2018-10-27 01:04:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282660   8 58418  3846026 A  ERROR'
2018-10-27 01:04:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-27 01:04:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:04:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:04:06 [DEBUG   ] spawn_process: at 2018-10-27 01:04:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:04:07 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:04:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 01:04:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:04:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:04:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:04:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:04:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:04:07 [DEBUG   ] Finished updating board flags in 1.551 seconds
2018-10-27 01:04:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 01:04:09 [DEBUG   ] Got command BAM from MCS: ref #282661
2018-10-27 01:04:09 [INFO    ] Finished processing BAM request
2018-10-27 01:04:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:04:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282661   8 58418  3849029 A  ERROR'
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:04:09 [DEBUG   ] spawn_process: at 2018-10-27 01:04:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:04:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:04:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:05:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:05:07 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:05:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 01:05:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:05:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:05:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:05:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:05:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:05:07 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-10-27 01:05:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 01:05:14 [DEBUG   ] Got command BAM from MCS: ref #282666
2018-10-27 01:05:14 [INFO    ] Finished processing BAM request
2018-10-27 01:05:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:05:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282666   8 58418  3914033 A  ERROR'
2018-10-27 01:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:05:14 [DEBUG   ] spawn_process: at 2018-10-27 01:05:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:05:15 [DEBUG   ] spawn_process: at 2018-10-27 01:05:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:05:20 [DEBUG   ] Got command BAM from MCS: ref #282667
2018-10-27 01:05:20 [INFO    ] Finished processing BAM request
2018-10-27 01:05:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:05:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282667   8 58418  3920025 A  ERROR'
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:05:20 [DEBUG   ] spawn_process: at 2018-10-27 01:05:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:05:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 01:05:37 [DEBUG   ] Got command RPT from MCS: ref #282668
2018-10-27 01:05:37 [DEBUG   ] summary = ERROR
2018-10-27 01:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282668  13 58418  3937569 A  ERRORERROR'
2018-10-27 01:05:37 [DEBUG   ] Got command RPT from MCS: ref #282669
2018-10-27 01:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282669  77 58418  3937570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:05:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 01:06:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-10-27 01:06:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 01:06:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:06:07 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:06:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-27 01:06:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:06:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:06:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:06:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:06:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:06:07 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-27 01:06:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:06:22 [DEBUG   ] Got command BAM from MCS: ref #282685
2018-10-27 01:06:22 [INFO    ] Finished processing BAM request
2018-10-27 01:06:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:06:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282685   8 58418  3982029 A  ERROR'
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:06:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:06:22 [DEBUG   ] spawn_process: at 2018-10-27 01:06:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:06:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 01:06:31 [DEBUG   ] Got command BAM from MCS: ref #282686
2018-10-27 01:06:31 [INFO    ] Finished processing BAM request
2018-10-27 01:06:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:06:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282686   8 58418  3991025 A  ERROR'
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:06:31 [DEBUG   ] spawn_process: at 2018-10-27 01:06:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:06:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 01:07:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-27 01:07:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-27 01:07:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:07:07 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:07:08 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 01:07:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 01:07:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 01:07:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:07:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:07:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:07:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:07:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:07:08 [DEBUG   ] Finished updating board flags in 2.312 seconds
2018-10-27 01:07:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 01:07:30 [DEBUG   ] Got command BAM from MCS: ref #282687
2018-10-27 01:07:30 [INFO    ] Finished processing BAM request
2018-10-27 01:07:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282687   8 58418  4050025 A  ERROR'
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:07:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:07:30 [DEBUG   ] spawn_process: at 2018-10-27 01:07:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:07:42 [DEBUG   ] Got command BAM from MCS: ref #282688
2018-10-27 01:07:42 [INFO    ] Finished processing BAM request
2018-10-27 01:07:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:07:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282688   8 58418  4062029 A  ERROR'
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:07:42 [DEBUG   ] spawn_process: at 2018-10-27 01:07:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:07:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 01:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-27 01:08:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 01:08:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 01:08:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:08:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-10-27 01:08:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:08:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:08:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:08:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:08:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:08:07 [DEBUG   ] Finished updating board flags in 1.247 seconds
2018-10-27 01:08:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 01:08:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:08:38 [DEBUG   ] Got command BAM from MCS: ref #282693
2018-10-27 01:08:38 [INFO    ] Finished processing BAM request
2018-10-27 01:08:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282693   8 58418  4118029 A  ERROR'
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:08:38 [DEBUG   ] spawn_process: at 2018-10-27 01:08:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:08:47 [DEBUG   ] Got command RPT from MCS: ref #282694
2018-10-27 01:08:47 [DEBUG   ] summary = ERROR
2018-10-27 01:08:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282694  13 58418  4127081 A  ERRORERROR'
2018-10-27 01:08:47 [DEBUG   ] Got command RPT from MCS: ref #282695
2018-10-27 01:08:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:08:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282695  77 58418  4127285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:08:47 [DEBUG   ] Got command RPT from MCS: ref #282696
2018-10-27 01:08:47 [DEBUG   ] summary = ERROR
2018-10-27 01:08:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282696  13 58418  4127478 A  ERRORERROR'
2018-10-27 01:08:47 [DEBUG   ] Got command RPT from MCS: ref #282697
2018-10-27 01:08:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:08:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282697  77 58418  4127681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:08:47 [DEBUG   ] Got command RPT from MCS: ref #282698
2018-10-27 01:08:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 01:08:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282698  12 58418  4127885 A  ERRORB¤ff'
2018-10-27 01:08:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 01:08:53 [DEBUG   ] Got command BAM from MCS: ref #282699
2018-10-27 01:08:53 [INFO    ] Finished processing BAM request
2018-10-27 01:08:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:08:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282699   8 58418  4133025 A  ERROR'
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:08:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:08:53 [DEBUG   ] spawn_process: at 2018-10-27 01:08:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:09:06 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-27 01:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 01:09:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:09:07 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:09:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-27 01:09:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 01:09:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:09:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:09:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:09:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:09:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:09:07 [DEBUG   ] Finished updating board flags in 1.192 seconds
2018-10-27 01:09:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:09:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:09:46 [DEBUG   ] Got command BAM from MCS: ref #282700
2018-10-27 01:09:46 [INFO    ] Finished processing BAM request
2018-10-27 01:09:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:09:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282700   8 58418  4186033 A  ERROR'
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:09:46 [DEBUG   ] spawn_process: at 2018-10-27 01:09:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:09:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:10:05 [DEBUG   ] Got command BAM from MCS: ref #282701
2018-10-27 01:10:05 [INFO    ] Finished processing BAM request
2018-10-27 01:10:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:10:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282701   8 58418  4205029 A  ERROR'
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 01:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 01:10:05 [DEBUG   ] spawn_process: at 2018-10-27 01:10:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 01:10:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 01:10:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:10:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-10-27 01:10:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:10:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-27 01:10:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:10:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:10:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:10:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:10:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:10:07 [DEBUG   ] Finished updating board flags in 0.999 seconds
2018-10-27 01:10:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 01:10:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:10:37 [DEBUG   ] Got command RPT from MCS: ref #282702
2018-10-27 01:10:37 [DEBUG   ] summary = ERROR
2018-10-27 01:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282702  13 58418  4237573 A  ERRORERROR'
2018-10-27 01:10:37 [DEBUG   ] Got command RPT from MCS: ref #282703
2018-10-27 01:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282703  77 58418  4237574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:10:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 01:10:54 [DEBUG   ] Got command BAM from MCS: ref #282719
2018-10-27 01:10:54 [INFO    ] Finished processing BAM request
2018-10-27 01:10:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282719   8 58418  4254029 A  ERROR'
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:10:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:10:54 [DEBUG   ] spawn_process: at 2018-10-27 01:10:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:11:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-27 01:11:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:11:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 01:11:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 01:11:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:11:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-27 01:11:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 01:11:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 01:11:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:11:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:11:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:11:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:11:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:11:08 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-10-27 01:11:17 [DEBUG   ] Got command BAM from MCS: ref #282724
2018-10-27 01:11:17 [INFO    ] Finished processing BAM request
2018-10-27 01:11:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:11:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282724   8 58418  4277033 A  ERROR'
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:11:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:11:17 [DEBUG   ] spawn_process: at 2018-10-27 01:11:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:11:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-27 01:11:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 01:12:02 [DEBUG   ] Got command BAM from MCS: ref #282725
2018-10-27 01:12:02 [INFO    ] Finished processing BAM request
2018-10-27 01:12:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282725   8 58418  4322029 A  ERROR'
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:12:02 [DEBUG   ] spawn_process: at 2018-10-27 01:12:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:12:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-27 01:12:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 01:12:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:12:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 01:12:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 01:12:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:12:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-27 01:12:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:12:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:12:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:12:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:12:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:12:07 [DEBUG   ] Finished updating board flags in 1.276 seconds
2018-10-27 01:12:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 01:12:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 01:12:29 [DEBUG   ] Got command BAM from MCS: ref #282726
2018-10-27 01:12:29 [INFO    ] Finished processing BAM request
2018-10-27 01:12:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:12:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282726   8 58418  4349025 A  ERROR'
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:12:29 [DEBUG   ] spawn_process: at 2018-10-27 01:12:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:12:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 01:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 01:13:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-27 01:13:08 [DEBUG   ] Finished updating ant stats in 0.630 seconds
2018-10-27 01:13:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:13:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-27 01:13:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:13:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:13:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:13:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:13:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:13:08 [DEBUG   ] Finished updating board flags in 1.769 seconds
2018-10-27 01:13:10 [DEBUG   ] Got command BAM from MCS: ref #282727
2018-10-27 01:13:10 [INFO    ] Finished processing BAM request
2018-10-27 01:13:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:13:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282727   8 58418  4390025 A  ERROR'
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:13:10 [DEBUG   ] spawn_process: at 2018-10-27 01:13:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:13:28 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-10-27 01:13:41 [DEBUG   ] Got command BAM from MCS: ref #282730
2018-10-27 01:13:41 [INFO    ] Finished processing BAM request
2018-10-27 01:13:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:13:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282730   8 58418  4421033 A  ERROR'
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:13:41 [DEBUG   ] spawn_process: at 2018-10-27 01:13:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:13:47 [DEBUG   ] Got command RPT from MCS: ref #282731
2018-10-27 01:13:47 [DEBUG   ] summary = ERROR
2018-10-27 01:13:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282731  13 58418  4427165 A  ERRORERROR'
2018-10-27 01:13:47 [DEBUG   ] Got command RPT from MCS: ref #282732
2018-10-27 01:13:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:13:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282732  77 58418  4427369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:13:47 [DEBUG   ] Got command RPT from MCS: ref #282733
2018-10-27 01:13:47 [DEBUG   ] summary = ERROR
2018-10-27 01:13:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282733  13 58418  4427561 A  ERRORERROR'
2018-10-27 01:13:47 [DEBUG   ] Got command RPT from MCS: ref #282735
2018-10-27 01:13:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:13:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282735  77 58418  4427765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:13:47 [DEBUG   ] Got command RPT from MCS: ref #282736
2018-10-27 01:13:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 01:13:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282736  12 58418  4427965 A  ERRORB¤ff'
2018-10-27 01:13:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 01:14:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 01:14:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 01:14:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:14:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 01:14:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 01:14:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:14:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 01:14:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:14:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:14:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:14:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:14:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:14:07 [DEBUG   ] Finished updating board flags in 1.035 seconds
2018-10-27 01:14:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 01:14:18 [DEBUG   ] Got command BAM from MCS: ref #282745
2018-10-27 01:14:18 [INFO    ] Finished processing BAM request
2018-10-27 01:14:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:14:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282745   8 58418  4458033 A  ERROR'
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:14:18 [DEBUG   ] spawn_process: at 2018-10-27 01:14:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:14:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 01:14:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 01:14:53 [DEBUG   ] Got command BAM from MCS: ref #282746
2018-10-27 01:14:53 [INFO    ] Finished processing BAM request
2018-10-27 01:14:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:14:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282746   8 58418  4493033 A  ERROR'
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:14:53 [DEBUG   ] spawn_process: at 2018-10-27 01:14:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:15:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-27 01:15:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-27 01:15:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:15:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:15:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-27 01:15:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:15:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:15:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:15:07 [WARNING ] (13, 1, 'bot')
2018-10-27 01:15:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:15:07 [DEBUG   ] Finished updating board flags in 0.997 seconds
2018-10-27 01:15:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 01:15:26 [DEBUG   ] Got command BAM from MCS: ref #282747
2018-10-27 01:15:26 [INFO    ] Finished processing BAM request
2018-10-27 01:15:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:15:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282747   8 58418  4526025 A  ERROR'
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 01:15:26 [DEBUG   ] spawn_process: at 2018-10-27 01:15:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 01:15:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 01:15:37 [DEBUG   ] Got command RPT from MCS: ref #282748
2018-10-27 01:15:37 [DEBUG   ] summary = ERROR
2018-10-27 01:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282748  13 58418  4537569 A  ERRORERROR'
2018-10-27 01:15:37 [DEBUG   ] Got command RPT from MCS: ref #282749
2018-10-27 01:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282749  77 58418  4537570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:15:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 01:16:05 [DEBUG   ] Got command BAM from MCS: ref #282765
2018-10-27 01:16:05 [INFO    ] Finished processing BAM request
2018-10-27 01:16:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282765   8 58418  4565029 A  ERROR'
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:16:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:16:05 [DEBUG   ] spawn_process: at 2018-10-27 01:16:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:16:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:16:08 [DEBUG   ] Finished updating ant stats in 0.434 seconds
2018-10-27 01:16:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:16:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-27 01:16:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 01:16:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:16:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:16:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:16:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:16:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:16:08 [DEBUG   ] Finished updating board flags in 1.395 seconds
2018-10-27 01:16:28 [DEBUG   ] Finished updating ant stats in 0.371 seconds
2018-10-27 01:16:34 [DEBUG   ] Got command BAM from MCS: ref #282766
2018-10-27 01:16:34 [INFO    ] Finished processing BAM request
2018-10-27 01:16:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:16:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282766   8 58418  4594033 A  ERROR'
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:16:34 [DEBUG   ] spawn_process: at 2018-10-27 01:16:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:16:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 01:17:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:17:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:17:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 01:17:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:17:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:17:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:17:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:17:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:17:08 [DEBUG   ] Finished updating board flags in 1.139 seconds
2018-10-27 01:17:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 01:17:17 [DEBUG   ] Got command BAM from MCS: ref #282771
2018-10-27 01:17:17 [INFO    ] Finished processing BAM request
2018-10-27 01:17:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:17:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282771   8 58418  4637025 A  ERROR'
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:17:17 [DEBUG   ] spawn_process: at 2018-10-27 01:17:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:17:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 01:17:42 [DEBUG   ] Got command BAM from MCS: ref #282772
2018-10-27 01:17:42 [INFO    ] Finished processing BAM request
2018-10-27 01:17:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:17:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282772   8 58418  4662025 A  ERROR'
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:17:42 [DEBUG   ] spawn_process: at 2018-10-27 01:17:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:17:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 01:18:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:18:09 [DEBUG   ] Finished updating ant stats in 1.226 seconds
2018-10-27 01:18:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:18:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:18:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:18:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:18:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:18:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:18:09 [DEBUG   ] Finished updating board flags in 2.049 seconds
2018-10-27 01:18:29 [DEBUG   ] Got command BAM from MCS: ref #282773
2018-10-27 01:18:29 [INFO    ] Finished processing BAM request
2018-10-27 01:18:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282773   8 58418  4709033 A  ERROR'
2018-10-27 01:18:29 [DEBUG   ] Finished updating ant stats in 1.174 seconds
2018-10-27 01:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:18:29 [DEBUG   ] spawn_process: at 2018-10-27 01:18:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:18:30 [DEBUG   ] spawn_process: at 2018-10-27 01:18:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:18:47 [DEBUG   ] Got command RPT from MCS: ref #282774
2018-10-27 01:18:47 [DEBUG   ] summary = ERROR
2018-10-27 01:18:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282774  13 58418  4727249 A  ERRORERROR'
2018-10-27 01:18:47 [DEBUG   ] Got command RPT from MCS: ref #282775
2018-10-27 01:18:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:18:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282775  77 58418  4727453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:18:47 [DEBUG   ] Got command RPT from MCS: ref #282776
2018-10-27 01:18:47 [DEBUG   ] summary = ERROR
2018-10-27 01:18:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282776  13 58418  4727645 A  ERRORERROR'
2018-10-27 01:18:47 [DEBUG   ] Got command RPT from MCS: ref #282777
2018-10-27 01:18:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:18:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282777  77 58418  4727849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:18:48 [DEBUG   ] Got command RPT from MCS: ref #282778
2018-10-27 01:18:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 01:18:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282778  12 58418  4728053 A  ERRORB¤ff'
2018-10-27 01:18:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 01:18:50 [DEBUG   ] Got command BAM from MCS: ref #282779
2018-10-27 01:18:50 [INFO    ] Finished processing BAM request
2018-10-27 01:18:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:18:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282779   8 58418  4730025 A  ERROR'
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 01:18:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 01:18:50 [DEBUG   ] spawn_process: at 2018-10-27 01:18:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 01:19:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:19:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:19:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 01:19:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:19:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:19:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:19:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:19:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:19:08 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-10-27 01:19:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 01:19:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 01:19:41 [DEBUG   ] Got command BAM from MCS: ref #282780
2018-10-27 01:19:41 [INFO    ] Finished processing BAM request
2018-10-27 01:19:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:19:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282780   8 58418  4781033 A  ERROR'
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:19:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:19:41 [DEBUG   ] spawn_process: at 2018-10-27 01:19:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:19:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 01:19:58 [DEBUG   ] Got command BAM from MCS: ref #282781
2018-10-27 01:19:58 [INFO    ] Finished processing BAM request
2018-10-27 01:19:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282781   8 58418  4798029 A  ERROR'
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:19:58 [DEBUG   ] spawn_process: at 2018-10-27 01:19:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:20:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:20:09 [DEBUG   ] Finished updating ant stats in 1.029 seconds
2018-10-27 01:20:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:20:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:20:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:20:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:20:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:20:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:20:09 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-27 01:20:29 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2018-10-27 01:20:37 [DEBUG   ] Got command RPT from MCS: ref #282786
2018-10-27 01:20:37 [DEBUG   ] summary = ERROR
2018-10-27 01:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282786  13 58418  4837565 A  ERRORERROR'
2018-10-27 01:20:37 [DEBUG   ] Got command RPT from MCS: ref #282787
2018-10-27 01:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282787  77 58418  4837566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:20:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 01:20:53 [DEBUG   ] Got command BAM from MCS: ref #282803
2018-10-27 01:20:53 [INFO    ] Finished processing BAM request
2018-10-27 01:20:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:20:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282803   8 58418  4853029 A  ERROR'
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:20:53 [DEBUG   ] spawn_process: at 2018-10-27 01:20:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:21:07 [DEBUG   ] Got command BAM from MCS: ref #282804
2018-10-27 01:21:07 [INFO    ] Finished processing BAM request
2018-10-27 01:21:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:21:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282804   8 58418  4867033 A  ERROR'
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:21:07 [DEBUG   ] spawn_process: at 2018-10-27 01:21:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:21:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-27 01:21:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:21:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 01:21:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-27 01:21:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:21:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-27 01:21:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 01:21:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:21:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:21:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:21:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:21:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:21:08 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-10-27 01:21:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:21:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:21:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 01:22:05 [DEBUG   ] Got command BAM from MCS: ref #282805
2018-10-27 01:22:05 [INFO    ] Finished processing BAM request
2018-10-27 01:22:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:22:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282805   8 58418  4925029 A  ERROR'
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:22:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:22:05 [DEBUG   ] spawn_process: at 2018-10-27 01:22:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:22:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 01:22:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:22:09 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 01:22:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:22:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-27 01:22:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 01:22:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:22:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:22:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:22:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:22:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:22:09 [DEBUG   ] Finished updating board flags in 2.152 seconds
2018-10-27 01:22:16 [DEBUG   ] Got command BAM from MCS: ref #282806
2018-10-27 01:22:16 [INFO    ] Finished processing BAM request
2018-10-27 01:22:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:22:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282806   8 58418  4936033 A  ERROR'
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:22:16 [DEBUG   ] spawn_process: at 2018-10-27 01:22:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:22:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 01:22:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 01:22:58 [DEBUG   ] Got command BAM from MCS: ref #282807
2018-10-27 01:22:58 [INFO    ] Finished processing BAM request
2018-10-27 01:22:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:22:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282807   8 58418  4978025 A  ERROR'
2018-10-27 01:22:58 [DEBUG   ] Got command BAM from MCS: ref #282808
2018-10-27 01:22:58 [INFO    ] Finished processing BAM request
2018-10-27 01:22:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:22:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282808   8 58418  4978029 A  ERROR'
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:22:58 [DEBUG   ] spawn_process: at 2018-10-27 01:22:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:23:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:23:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 01:23:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:23:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-27 01:23:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 01:23:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:23:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:23:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:23:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:23:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:23:08 [DEBUG   ] Finished updating board flags in 1.238 seconds
2018-10-27 01:23:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 01:23:21 [DEBUG   ] Got command BAM from MCS: ref #282815
2018-10-27 01:23:21 [INFO    ] Finished processing BAM request
2018-10-27 01:23:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282815   8 58418  5001033 A  ERROR'
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:23:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:23:21 [DEBUG   ] spawn_process: at 2018-10-27 01:23:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:23:26 [DEBUG   ] Got command BAM from MCS: ref #282818
2018-10-27 01:23:26 [INFO    ] Finished processing BAM request
2018-10-27 01:23:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282818   8 58418  5006029 A  ERROR'
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:23:26 [DEBUG   ] spawn_process: at 2018-10-27 01:23:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:23:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 01:23:44 [DEBUG   ] Got command BAM from MCS: ref #282819
2018-10-27 01:23:44 [INFO    ] Finished processing BAM request
2018-10-27 01:23:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:23:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282819   8 58418  5024029 A  ERROR'
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:23:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:23:44 [DEBUG   ] spawn_process: at 2018-10-27 01:23:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:23:47 [DEBUG   ] Got command RPT from MCS: ref #282820
2018-10-27 01:23:47 [DEBUG   ] summary = ERROR
2018-10-27 01:23:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282820  13 58418  5027341 A  ERRORERROR'
2018-10-27 01:23:47 [DEBUG   ] Got command RPT from MCS: ref #282821
2018-10-27 01:23:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:23:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282821  77 58418  5027533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:23:47 [DEBUG   ] Got command RPT from MCS: ref #282822
2018-10-27 01:23:47 [DEBUG   ] summary = ERROR
2018-10-27 01:23:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282822  13 58418  5027737 A  ERRORERROR'
2018-10-27 01:23:47 [DEBUG   ] Got command RPT from MCS: ref #282824
2018-10-27 01:23:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:23:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282824  77 58418  5027941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:23:48 [DEBUG   ] Got command RPT from MCS: ref #282825
2018-10-27 01:23:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 01:23:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282825  12 58418  5028133 A  ERRORB£ff'
2018-10-27 01:23:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 01:23:54 [DEBUG   ] Got command BAM from MCS: ref #282830
2018-10-27 01:23:54 [INFO    ] Finished processing BAM request
2018-10-27 01:23:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:23:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282830   8 58418  5034029 A  ERROR'
2018-10-27 01:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:23:54 [DEBUG   ] spawn_process: at 2018-10-27 01:23:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:23:55 [DEBUG   ] spawn_process: at 2018-10-27 01:23:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:24:07 [DEBUG   ] Got command BAM from MCS: ref #282831
2018-10-27 01:24:07 [INFO    ] Finished processing BAM request
2018-10-27 01:24:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:24:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282831   8 58418  5047029 A  ERROR'
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:24:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:24:07 [DEBUG   ] spawn_process: at 2018-10-27 01:24:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:24:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 01:24:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-27 01:24:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 01:24:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 01:24:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:24:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:24:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-27 01:24:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:24:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:24:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:24:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:24:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:24:08 [DEBUG   ] Finished updating board flags in 1.211 seconds
2018-10-27 01:24:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 01:24:22 [DEBUG   ] Got command BAM from MCS: ref #282832
2018-10-27 01:24:22 [INFO    ] Finished processing BAM request
2018-10-27 01:24:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:24:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282832   8 58418  5062025 A  ERROR'
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:24:22 [DEBUG   ] spawn_process: at 2018-10-27 01:24:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:24:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 01:24:30 [DEBUG   ] Got command BAM from MCS: ref #282833
2018-10-27 01:24:30 [INFO    ] Finished processing BAM request
2018-10-27 01:24:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:24:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282833   8 58418  5070033 A  ERROR'
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 01:24:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 01:24:30 [DEBUG   ] spawn_process: at 2018-10-27 01:24:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 01:24:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 01:24:50 [DEBUG   ] Got command BAM from MCS: ref #282834
2018-10-27 01:24:50 [INFO    ] Finished processing BAM request
2018-10-27 01:24:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:24:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282834   8 58418  5090029 A  ERROR'
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 01:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 01:24:50 [DEBUG   ] spawn_process: at 2018-10-27 01:24:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 01:24:53 [DEBUG   ] Got command BAM from MCS: ref #282835
2018-10-27 01:24:53 [INFO    ] Finished processing BAM request
2018-10-27 01:24:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:24:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282835   8 58418  5093033 A  ERROR'
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:24:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:24:53 [DEBUG   ] spawn_process: at 2018-10-27 01:24:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:24:58 [DEBUG   ] Got command BAM from MCS: ref #282836
2018-10-27 01:24:58 [INFO    ] Finished processing BAM request
2018-10-27 01:24:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282836   8 58418  5098029 A  ERROR'
2018-10-27 01:24:58 [DEBUG   ] Got command BAM from MCS: ref #282837
2018-10-27 01:24:58 [INFO    ] Finished processing BAM request
2018-10-27 01:24:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282837   8 58418  5098033 A  ERROR'
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:24:58 [DEBUG   ] spawn_process: at 2018-10-27 01:24:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:25:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-27 01:25:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-10-27 01:25:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:25:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:25:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 01:25:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 01:25:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:25:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:25:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:25:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:25:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:25:08 [DEBUG   ] Finished updating board flags in 1.210 seconds
2018-10-27 01:25:09 [DEBUG   ] Finished updating ant stats in 0.395 seconds
2018-10-27 01:25:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 01:25:37 [DEBUG   ] Got command RPT from MCS: ref #282840
2018-10-27 01:25:37 [DEBUG   ] summary = ERROR
2018-10-27 01:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282840  13 58418  5137569 A  ERRORERROR'
2018-10-27 01:25:37 [DEBUG   ] Got command RPT from MCS: ref #282841
2018-10-27 01:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282841  77 58418  5137570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:25:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 01:26:07 [DEBUG   ] Got command BAM from MCS: ref #282861
2018-10-27 01:26:07 [INFO    ] Finished processing BAM request
2018-10-27 01:26:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:26:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282861   8 58418  5167033 A  ERROR'
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:26:07 [DEBUG   ] spawn_process: at 2018-10-27 01:26:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:26:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-27 01:26:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-27 01:26:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 01:26:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:26:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:26:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-10-27 01:26:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:26:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:26:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:26:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:26:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:26:08 [DEBUG   ] Finished updating board flags in 1.153 seconds
2018-10-27 01:26:10 [DEBUG   ] Got command BAM from MCS: ref #282862
2018-10-27 01:26:10 [INFO    ] Finished processing BAM request
2018-10-27 01:26:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:26:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282862   8 58418  5170025 A  ERROR'
2018-10-27 01:26:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:26:10 [DEBUG   ] spawn_process: at 2018-10-27 01:26:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:26:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 01:26:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 01:27:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-27 01:27:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-27 01:27:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:27:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 01:27:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:27:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 01:27:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 01:27:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:27:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:27:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:27:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:27:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:27:09 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-27 01:27:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 01:27:16 [DEBUG   ] Got command BAM from MCS: ref #282863
2018-10-27 01:27:16 [INFO    ] Finished processing BAM request
2018-10-27 01:27:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:27:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282863   8 58418  5236033 A  ERROR'
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:27:16 [DEBUG   ] spawn_process: at 2018-10-27 01:27:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:27:22 [DEBUG   ] Got command BAM from MCS: ref #282864
2018-10-27 01:27:22 [INFO    ] Finished processing BAM request
2018-10-27 01:27:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:27:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282864   8 58418  5242029 A  ERROR'
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 01:27:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 01:27:22 [DEBUG   ] spawn_process: at 2018-10-27 01:27:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 01:27:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-27 01:27:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:28:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:28:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:28:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:28:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:28:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:28:08 [WARNING ] (13, 1, 'bot')
2018-10-27 01:28:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:28:08 [DEBUG   ] Finished updating board flags in 0.986 seconds
2018-10-27 01:28:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:28:25 [DEBUG   ] Got command BAM from MCS: ref #282865
2018-10-27 01:28:25 [INFO    ] Finished processing BAM request
2018-10-27 01:28:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282865   8 58418  5305029 A  ERROR'
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:28:25 [DEBUG   ] spawn_process: at 2018-10-27 01:28:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:28:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:28:34 [DEBUG   ] Got command BAM from MCS: ref #282866
2018-10-27 01:28:34 [INFO    ] Finished processing BAM request
2018-10-27 01:28:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282866   8 58418  5314029 A  ERROR'
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:28:34 [DEBUG   ] spawn_process: at 2018-10-27 01:28:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:28:47 [DEBUG   ] Got command RPT from MCS: ref #282867
2018-10-27 01:28:47 [DEBUG   ] summary = ERROR
2018-10-27 01:28:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282867  13 58418  5327425 A  ERRORERROR'
2018-10-27 01:28:47 [DEBUG   ] Got command RPT from MCS: ref #282868
2018-10-27 01:28:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:28:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282868  77 58418  5327617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:28:47 [DEBUG   ] Got command RPT from MCS: ref #282869
2018-10-27 01:28:47 [DEBUG   ] summary = ERROR
2018-10-27 01:28:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282869  13 58418  5327821 A  ERRORERROR'
2018-10-27 01:28:48 [DEBUG   ] Got command RPT from MCS: ref #282870
2018-10-27 01:28:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:28:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282870  77 58418  5328025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:28:48 [DEBUG   ] Got command RPT from MCS: ref #282871
2018-10-27 01:28:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 01:28:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282871  12 58418  5328229 A  ERRORB£ff'
2018-10-27 01:28:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:29:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-27 01:29:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:29:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:29:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 01:29:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2018-10-27 01:29:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:29:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:29:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:29:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:29:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:29:09 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-27 01:29:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 01:29:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:29:34 [DEBUG   ] Got command BAM from MCS: ref #282876
2018-10-27 01:29:34 [INFO    ] Finished processing BAM request
2018-10-27 01:29:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:29:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282876   8 58418  5374025 A  ERROR'
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:29:34 [DEBUG   ] spawn_process: at 2018-10-27 01:29:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:29:46 [DEBUG   ] Got command BAM from MCS: ref #282877
2018-10-27 01:29:46 [INFO    ] Finished processing BAM request
2018-10-27 01:29:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:29:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282877   8 58418  5386029 A  ERROR'
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:29:46 [DEBUG   ] spawn_process: at 2018-10-27 01:29:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:29:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 01:30:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:30:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:30:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:30:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:30:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:30:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:30:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:30:09 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-10-27 01:30:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 01:30:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:30:37 [DEBUG   ] Got command RPT from MCS: ref #282878
2018-10-27 01:30:37 [DEBUG   ] summary = ERROR
2018-10-27 01:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282878  13 58418  5437573 A  ERRORERROR'
2018-10-27 01:30:37 [DEBUG   ] Got command RPT from MCS: ref #282879
2018-10-27 01:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282879  77 58418  5437574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:30:43 [DEBUG   ] Got command BAM from MCS: ref #282895
2018-10-27 01:30:43 [INFO    ] Finished processing BAM request
2018-10-27 01:30:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:30:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282895   8 58418  5443025 A  ERROR'
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:30:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:30:43 [DEBUG   ] spawn_process: at 2018-10-27 01:30:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:30:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:30:58 [DEBUG   ] Got command BAM from MCS: ref #282896
2018-10-27 01:30:58 [INFO    ] Finished processing BAM request
2018-10-27 01:30:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282896   8 58418  5458025 A  ERROR'
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:30:58 [DEBUG   ] spawn_process: at 2018-10-27 01:30:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:31:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:31:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:31:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 01:31:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:31:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:31:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:31:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:31:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:31:09 [DEBUG   ] Finished updating board flags in 1.208 seconds
2018-10-27 01:31:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:31:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:31:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:31:52 [DEBUG   ] Got command BAM from MCS: ref #282897
2018-10-27 01:31:52 [INFO    ] Finished processing BAM request
2018-10-27 01:31:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:31:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282897   8 58418  5512033 A  ERROR'
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:31:52 [DEBUG   ] spawn_process: at 2018-10-27 01:31:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:32:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 01:32:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:32:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:32:10 [DEBUG   ] Got command BAM from MCS: ref #282902
2018-10-27 01:32:10 [INFO    ] Finished processing BAM request
2018-10-27 01:32:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:32:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282902   8 58418  5530029 A  ERROR'
2018-10-27 01:32:10 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 01:32:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 01:32:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:32:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:32:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:32:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:32:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:32:10 [DEBUG   ] Finished updating board flags in 2.126 seconds
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 01:32:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 01:32:10 [DEBUG   ] spawn_process: at 2018-10-27 01:32:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 01:32:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 01:32:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 01:33:01 [DEBUG   ] Got command BAM from MCS: ref #282903
2018-10-27 01:33:01 [INFO    ] Finished processing BAM request
2018-10-27 01:33:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:33:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282903   8 58418  5581033 A  ERROR'
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:33:01 [DEBUG   ] spawn_process: at 2018-10-27 01:33:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:33:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-27 01:33:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-27 01:33:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:33:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-10-27 01:33:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:33:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:33:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:33:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:33:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:33:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:33:09 [DEBUG   ] Finished updating board flags in 1.049 seconds
2018-10-27 01:33:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 01:33:23 [DEBUG   ] Got command BAM from MCS: ref #282904
2018-10-27 01:33:23 [INFO    ] Finished processing BAM request
2018-10-27 01:33:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282904   8 58418  5603029 A  ERROR'
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:33:23 [DEBUG   ] spawn_process: at 2018-10-27 01:33:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:33:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 01:33:47 [DEBUG   ] Got command RPT from MCS: ref #282907
2018-10-27 01:33:47 [DEBUG   ] summary = ERROR
2018-10-27 01:33:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282907  13 58418  5627501 A  ERRORERROR'
2018-10-27 01:33:47 [DEBUG   ] Got command RPT from MCS: ref #282908
2018-10-27 01:33:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:33:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282908  77 58418  5627705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:33:47 [DEBUG   ] Got command RPT from MCS: ref #282909
2018-10-27 01:33:47 [DEBUG   ] summary = ERROR
2018-10-27 01:33:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282909  13 58418  5627909 A  ERRORERROR'
2018-10-27 01:33:48 [DEBUG   ] Got command RPT from MCS: ref #282911
2018-10-27 01:33:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:33:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282911  77 58418  5628101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:33:48 [DEBUG   ] Got command RPT from MCS: ref #282912
2018-10-27 01:33:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 01:33:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282912  12 58418  5628305 A  ERRORB£ff'
2018-10-27 01:33:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 01:34:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 01:34:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 01:34:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:34:09 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:34:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:34:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:34:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:34:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:34:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:34:09 [DEBUG   ] Finished updating board flags in 1.008 seconds
2018-10-27 01:34:10 [DEBUG   ] Got command BAM from MCS: ref #282917
2018-10-27 01:34:10 [INFO    ] Finished processing BAM request
2018-10-27 01:34:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:34:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282917   8 58418  5650025 A  ERROR'
2018-10-27 01:34:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:34:10 [DEBUG   ] spawn_process: at 2018-10-27 01:34:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:34:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 01:34:36 [DEBUG   ] Got command BAM from MCS: ref #282918
2018-10-27 01:34:36 [INFO    ] Finished processing BAM request
2018-10-27 01:34:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:34:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282918   8 58418  5676029 A  ERROR'
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:34:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:34:36 [DEBUG   ] spawn_process: at 2018-10-27 01:34:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:34:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 01:35:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:35:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:35:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:35:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:35:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:35:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:35:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:35:09 [DEBUG   ] Finished updating board flags in 1.070 seconds
2018-10-27 01:35:10 [DEBUG   ] Finished updating ant stats in 0.391 seconds
2018-10-27 01:35:19 [DEBUG   ] Got command BAM from MCS: ref #282923
2018-10-27 01:35:19 [INFO    ] Finished processing BAM request
2018-10-27 01:35:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:35:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282923   8 58418  5719025 A  ERROR'
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:35:19 [DEBUG   ] spawn_process: at 2018-10-27 01:35:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:35:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 01:35:37 [DEBUG   ] Got command RPT from MCS: ref #282924
2018-10-27 01:35:37 [DEBUG   ] summary = ERROR
2018-10-27 01:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282924  13 58418  5737569 A  ERRORERROR'
2018-10-27 01:35:37 [DEBUG   ] Got command RPT from MCS: ref #282925
2018-10-27 01:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282925  77 58418  5737570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:35:49 [DEBUG   ] Got command BAM from MCS: ref #282941
2018-10-27 01:35:49 [INFO    ] Finished processing BAM request
2018-10-27 01:35:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282941   8 58418  5749033 A  ERROR'
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:35:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:35:49 [DEBUG   ] spawn_process: at 2018-10-27 01:35:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:35:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 01:36:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 01:36:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 01:36:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:36:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 01:36:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:36:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:36:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:36:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:36:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:36:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:36:11 [DEBUG   ] Finished updating board flags in 3.093 seconds
2018-10-27 01:36:28 [DEBUG   ] Got command BAM from MCS: ref #282942
2018-10-27 01:36:28 [INFO    ] Finished processing BAM request
2018-10-27 01:36:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:36:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282942   8 58418  5788033 A  ERROR'
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 01:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 01:36:28 [DEBUG   ] spawn_process: at 2018-10-27 01:36:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 01:36:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 01:36:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:37:02 [DEBUG   ] Got command BAM from MCS: ref #282943
2018-10-27 01:37:02 [INFO    ] Finished processing BAM request
2018-10-27 01:37:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282943   8 58418  5822029 A  ERROR'
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:37:02 [DEBUG   ] spawn_process: at 2018-10-27 01:37:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:37:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-27 01:37:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:37:09 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:37:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:37:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:37:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:37:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:37:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:37:09 [DEBUG   ] Finished updating board flags in 1.270 seconds
2018-10-27 01:37:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:37:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:37:38 [DEBUG   ] Got command BAM from MCS: ref #282944
2018-10-27 01:37:38 [INFO    ] Finished processing BAM request
2018-10-27 01:37:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:37:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282944   8 58418  5858029 A  ERROR'
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:37:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:37:38 [DEBUG   ] spawn_process: at 2018-10-27 01:37:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:37:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:38:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 01:38:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:38:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:38:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:38:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:38:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:38:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:38:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:38:09 [DEBUG   ] Finished updating board flags in 1.253 seconds
2018-10-27 01:38:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:38:15 [DEBUG   ] Got command BAM from MCS: ref #282949
2018-10-27 01:38:15 [INFO    ] Finished processing BAM request
2018-10-27 01:38:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:38:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282949   8 58418  5895029 A  ERROR'
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:38:15 [DEBUG   ] spawn_process: at 2018-10-27 01:38:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:38:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:38:47 [DEBUG   ] Got command RPT from MCS: ref #282951
2018-10-27 01:38:47 [DEBUG   ] summary = ERROR
2018-10-27 01:38:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282951  13 58418  5927585 A  ERRORERROR'
2018-10-27 01:38:47 [DEBUG   ] Got command RPT from MCS: ref #282952
2018-10-27 01:38:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:38:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282952  77 58418  5927789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:38:47 [DEBUG   ] Got command RPT from MCS: ref #282953
2018-10-27 01:38:47 [DEBUG   ] summary = ERROR
2018-10-27 01:38:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282953  13 58418  5927993 A  ERRORERROR'
2018-10-27 01:38:48 [DEBUG   ] Got command BAM from MCS: ref #282950
2018-10-27 01:38:48 [INFO    ] Finished processing BAM request
2018-10-27 01:38:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:38:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282950   8 58418  5928033 A  ERROR'
2018-10-27 01:38:48 [DEBUG   ] Got command RPT from MCS: ref #282954
2018-10-27 01:38:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:38:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282954  77 58418  5928189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:38:48 [DEBUG   ] Got command RPT from MCS: ref #282955
2018-10-27 01:38:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 01:38:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282955  12 58418  5928396 A  ERRORB£ff'
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:38:48 [DEBUG   ] spawn_process: at 2018-10-27 01:38:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:38:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:39:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-27 01:39:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2018-10-27 01:39:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:39:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:39:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 01:39:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:39:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:39:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:39:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:39:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:39:09 [DEBUG   ] Finished updating board flags in 1.179 seconds
2018-10-27 01:39:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:39:28 [DEBUG   ] Got command BAM from MCS: ref #282956
2018-10-27 01:39:28 [INFO    ] Finished processing BAM request
2018-10-27 01:39:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:39:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282956   8 58418  5968029 A  ERROR'
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:39:28 [DEBUG   ] spawn_process: at 2018-10-27 01:39:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:39:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:39:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:39:58 [DEBUG   ] Got command BAM from MCS: ref #282957
2018-10-27 01:39:58 [INFO    ] Finished processing BAM request
2018-10-27 01:39:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:39:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282957   8 58418  5998025 A  ERROR'
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:39:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:39:58 [DEBUG   ] spawn_process: at 2018-10-27 01:39:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:40:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-27 01:40:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 01:40:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 01:40:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:40:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-27 01:40:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:40:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:40:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:40:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:40:09 [WARNING ] (13, 1, 'bot')
2018-10-27 01:40:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:40:09 [DEBUG   ] Finished updating board flags in 0.977 seconds
2018-10-27 01:40:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 01:40:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:40:37 [DEBUG   ] Got command RPT from MCS: ref #282958
2018-10-27 01:40:37 [DEBUG   ] summary = ERROR
2018-10-27 01:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282958  13 58418  6037573 A  ERRORERROR'
2018-10-27 01:40:37 [DEBUG   ] Got command RPT from MCS: ref #282959
2018-10-27 01:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282959  77 58418  6037574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:40:41 [DEBUG   ] Got command BAM from MCS: ref #282975
2018-10-27 01:40:41 [INFO    ] Finished processing BAM request
2018-10-27 01:40:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:40:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282975   8 58418  6041033 A  ERROR'
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:40:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:40:41 [DEBUG   ] spawn_process: at 2018-10-27 01:40:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:40:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:41:08 [DEBUG   ] Got command BAM from MCS: ref #282980
2018-10-27 01:41:08 [INFO    ] Finished processing BAM request
2018-10-27 01:41:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:41:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282980   8 58418  6068029 A  ERROR'
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:41:08 [DEBUG   ] spawn_process: at 2018-10-27 01:41:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:41:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:41:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2018-10-27 01:41:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:41:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:41:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:41:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:41:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:41:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:41:10 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-10-27 01:41:11 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-10-27 01:41:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:41:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:41:54 [DEBUG   ] Got command BAM from MCS: ref #282981
2018-10-27 01:41:54 [INFO    ] Finished processing BAM request
2018-10-27 01:41:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:41:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282981   8 58418  6114033 A  ERROR'
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 01:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 01:41:54 [DEBUG   ] spawn_process: at 2018-10-27 01:41:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 01:42:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:42:10 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:42:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 01:42:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:42:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:42:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:42:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:42:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:42:10 [DEBUG   ] Finished updating board flags in 1.203 seconds
2018-10-27 01:42:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:42:18 [DEBUG   ] Got command BAM from MCS: ref #282982
2018-10-27 01:42:18 [INFO    ] Finished processing BAM request
2018-10-27 01:42:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:42:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282982   8 58418  6138033 A  ERROR'
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:42:18 [DEBUG   ] spawn_process: at 2018-10-27 01:42:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:42:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:42:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:43:07 [DEBUG   ] Got command BAM from MCS: ref #282983
2018-10-27 01:43:07 [INFO    ] Finished processing BAM request
2018-10-27 01:43:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:43:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282983   8 58418  6187025 A  ERROR'
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:43:07 [DEBUG   ] spawn_process: at 2018-10-27 01:43:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:43:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-10-27 01:43:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 01:43:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 01:43:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:43:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 01:43:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 01:43:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:43:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:43:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:43:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:43:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:43:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:43:10 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-10-27 01:43:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:43:28 [DEBUG   ] Got command BAM from MCS: ref #282986
2018-10-27 01:43:28 [INFO    ] Finished processing BAM request
2018-10-27 01:43:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   282986   8 58418  6208033 A  ERROR'
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 01:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 01:43:28 [DEBUG   ] spawn_process: at 2018-10-27 01:43:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 01:43:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:43:47 [DEBUG   ] Got command RPT from MCS: ref #282987
2018-10-27 01:43:47 [DEBUG   ] summary = ERROR
2018-10-27 01:43:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282987  13 58418  6227681 A  ERRORERROR'
2018-10-27 01:43:47 [DEBUG   ] Got command RPT from MCS: ref #282988
2018-10-27 01:43:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:43:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282988  77 58418  6227873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:43:48 [DEBUG   ] Got command RPT from MCS: ref #282989
2018-10-27 01:43:48 [DEBUG   ] summary = ERROR
2018-10-27 01:43:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282989  13 58418  6228077 A  ERRORERROR'
2018-10-27 01:43:48 [DEBUG   ] Got command RPT from MCS: ref #282991
2018-10-27 01:43:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:43:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282991  77 58418  6228281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:43:48 [DEBUG   ] Got command RPT from MCS: ref #282993
2018-10-27 01:43:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 01:43:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   282993  12 58418  6228485 A  ERRORB£ff'
2018-10-27 01:43:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:44:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 01:44:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 01:44:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 01:44:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:44:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 01:44:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 01:44:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:44:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:44:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:44:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:44:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:44:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:44:11 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-10-27 01:44:11 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-10-27 01:44:20 [DEBUG   ] Got command BAM from MCS: ref #283001
2018-10-27 01:44:20 [INFO    ] Finished processing BAM request
2018-10-27 01:44:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283001   8 58418  6260029 A  ERROR'
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:44:20 [DEBUG   ] spawn_process: at 2018-10-27 01:44:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:44:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 01:44:38 [DEBUG   ] Got command BAM from MCS: ref #283002
2018-10-27 01:44:38 [INFO    ] Finished processing BAM request
2018-10-27 01:44:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:44:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283002   8 58418  6278029 A  ERROR'
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 01:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 01:44:38 [DEBUG   ] spawn_process: at 2018-10-27 01:44:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 01:44:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 01:44:58 [DEBUG   ] Got command BAM from MCS: ref #283003
2018-10-27 01:44:58 [INFO    ] Finished processing BAM request
2018-10-27 01:44:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283003   8 58418  6298025 A  ERROR'
2018-10-27 01:44:58 [DEBUG   ] Got command BAM from MCS: ref #283004
2018-10-27 01:44:58 [INFO    ] Finished processing BAM request
2018-10-27 01:44:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283004   8 58418  6298029 A  ERROR'
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 01:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 01:44:58 [DEBUG   ] spawn_process: at 2018-10-27 01:44:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 01:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 01:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-27 01:45:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:45:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2018-10-27 01:45:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:45:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:45:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:45:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:45:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:45:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:45:10 [DEBUG   ] Finished updating board flags in 0.980 seconds
2018-10-27 01:45:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 01:45:22 [DEBUG   ] Got command BAM from MCS: ref #283007
2018-10-27 01:45:22 [INFO    ] Finished processing BAM request
2018-10-27 01:45:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:45:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283007   8 58418  6322029 A  ERROR'
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:45:22 [DEBUG   ] spawn_process: at 2018-10-27 01:45:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:45:27 [DEBUG   ] Got command BAM from MCS: ref #283008
2018-10-27 01:45:27 [INFO    ] Finished processing BAM request
2018-10-27 01:45:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:45:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283008   8 58418  6327029 A  ERROR'
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:45:27 [DEBUG   ] spawn_process: at 2018-10-27 01:45:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:45:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 01:45:37 [DEBUG   ] Got command RPT from MCS: ref #283009
2018-10-27 01:45:37 [DEBUG   ] summary = ERROR
2018-10-27 01:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283009  13 58418  6337569 A  ERRORERROR'
2018-10-27 01:45:37 [DEBUG   ] Got command RPT from MCS: ref #283010
2018-10-27 01:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283010  77 58418  6337570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:45:46 [DEBUG   ] Got command BAM from MCS: ref #283026
2018-10-27 01:45:46 [INFO    ] Finished processing BAM request
2018-10-27 01:45:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:45:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283026   8 58418  6346033 A  ERROR'
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:45:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:45:46 [DEBUG   ] spawn_process: at 2018-10-27 01:45:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:45:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 01:45:56 [DEBUG   ] Got command BAM from MCS: ref #283027
2018-10-27 01:45:56 [INFO    ] Finished processing BAM request
2018-10-27 01:45:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:45:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283027   8 58418  6356029 A  ERROR'
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:45:56 [DEBUG   ] spawn_process: at 2018-10-27 01:45:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:46:10 [DEBUG   ] Got command BAM from MCS: ref #283028
2018-10-27 01:46:10 [INFO    ] Finished processing BAM request
2018-10-27 01:46:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:46:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283028   8 58418  6370029 A  ERROR'
2018-10-27 01:46:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:46:10 [DEBUG   ] spawn_process: at 2018-10-27 01:46:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:46:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 01:46:11 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2018-10-27 01:46:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:46:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:46:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:46:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:46:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:46:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:46:11 [DEBUG   ] Finished updating board flags in 1.870 seconds
2018-10-27 01:46:25 [DEBUG   ] Got command BAM from MCS: ref #283029
2018-10-27 01:46:25 [INFO    ] Finished processing BAM request
2018-10-27 01:46:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:46:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283029   8 58418  6385033 A  ERROR'
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:46:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:46:25 [DEBUG   ] spawn_process: at 2018-10-27 01:46:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:46:31 [DEBUG   ] Finished updating ant stats in 0.375 seconds
2018-10-27 01:46:34 [DEBUG   ] Got command BAM from MCS: ref #283030
2018-10-27 01:46:34 [INFO    ] Finished processing BAM request
2018-10-27 01:46:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:46:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283030   8 58418  6394025 A  ERROR'
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:46:34 [DEBUG   ] spawn_process: at 2018-10-27 01:46:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:46:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 01:46:55 [DEBUG   ] Got command BAM from MCS: ref #283031
2018-10-27 01:46:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:46:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283031   8 58418  6415029 A  ERROR'
2018-10-27 01:46:55 [INFO    ] Finished processing BAM request
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:46:55 [DEBUG   ] spawn_process: at 2018-10-27 01:46:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:46:58 [DEBUG   ] Got command BAM from MCS: ref #283032
2018-10-27 01:46:58 [INFO    ] Finished processing BAM request
2018-10-27 01:46:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:46:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283032   8 58418  6418033 A  ERROR'
2018-10-27 01:46:58 [DEBUG   ] Got command BAM from MCS: ref #283033
2018-10-27 01:46:58 [INFO    ] Finished processing BAM request
2018-10-27 01:46:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:46:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283033   8 58418  6418037 A  ERROR'
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:46:58 [DEBUG   ] spawn_process: at 2018-10-27 01:46:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:47:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 01:47:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-27 01:47:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:47:10 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:47:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:47:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:47:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:47:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:47:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:47:10 [DEBUG   ] Finished updating board flags in 1.180 seconds
2018-10-27 01:47:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 01:47:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 01:47:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 01:48:09 [DEBUG   ] Got command BAM from MCS: ref #283040
2018-10-27 01:48:09 [INFO    ] Finished processing BAM request
2018-10-27 01:48:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:48:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283040   8 58418  6489029 A  ERROR'
2018-10-27 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:48:09 [DEBUG   ] spawn_process: at 2018-10-27 01:48:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:48:10 [DEBUG   ] spawn_process: at 2018-10-27 01:48:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:48:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:48:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 01:48:12 [DEBUG   ] Got command BAM from MCS: ref #283041
2018-10-27 01:48:12 [INFO    ] Finished processing BAM request
2018-10-27 01:48:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:48:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283041   8 58418  6492033 A  ERROR'
2018-10-27 01:48:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 01:48:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-10-27 01:48:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 01:48:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:48:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:48:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:48:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:48:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:48:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:48:12 [DEBUG   ] Finished updating board flags in 2.726 seconds
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:48:12 [DEBUG   ] spawn_process: at 2018-10-27 01:48:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:48:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 01:48:47 [DEBUG   ] Got command RPT from MCS: ref #283042
2018-10-27 01:48:47 [DEBUG   ] summary = ERROR
2018-10-27 01:48:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283042  13 58418  6527757 A  ERRORERROR'
2018-10-27 01:48:47 [DEBUG   ] Got command RPT from MCS: ref #283043
2018-10-27 01:48:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:48:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283043  77 58418  6527961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:48:48 [DEBUG   ] Got command RPT from MCS: ref #283044
2018-10-27 01:48:48 [DEBUG   ] summary = ERROR
2018-10-27 01:48:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283044  13 58418  6528165 A  ERRORERROR'
2018-10-27 01:48:48 [DEBUG   ] Got command RPT from MCS: ref #283045
2018-10-27 01:48:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:48:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283045  77 58418  6528369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:48:48 [DEBUG   ] Got command RPT from MCS: ref #283046
2018-10-27 01:48:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 01:48:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283046  12 58418  6528561 A  ERRORB¢ff'
2018-10-27 01:48:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:49:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:49:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:49:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:49:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:49:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:49:10 [WARNING ] (13, 1, 'bot')
2018-10-27 01:49:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:49:10 [DEBUG   ] Finished updating board flags in 0.909 seconds
2018-10-27 01:49:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:49:20 [DEBUG   ] Got command BAM from MCS: ref #283047
2018-10-27 01:49:20 [INFO    ] Finished processing BAM request
2018-10-27 01:49:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283047   8 58418  6560025 A  ERROR'
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:49:20 [DEBUG   ] spawn_process: at 2018-10-27 01:49:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:49:26 [DEBUG   ] Got command BAM from MCS: ref #283048
2018-10-27 01:49:26 [INFO    ] Finished processing BAM request
2018-10-27 01:49:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:49:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283048   8 58418  6566029 A  ERROR'
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:49:26 [DEBUG   ] spawn_process: at 2018-10-27 01:49:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:49:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 01:49:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 01:50:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 01:50:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 01:50:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:50:12 [DEBUG   ] Finished updating ant stats in 1.026 seconds
2018-10-27 01:50:12 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:50:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 01:50:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:50:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:50:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:50:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:50:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:50:12 [DEBUG   ] Finished updating board flags in 2.406 seconds
2018-10-27 01:50:31 [DEBUG   ] Got command BAM from MCS: ref #283053
2018-10-27 01:50:31 [INFO    ] Finished processing BAM request
2018-10-27 01:50:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:50:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283053   8 58418  6631029 A  ERROR'
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:50:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:50:31 [DEBUG   ] spawn_process: at 2018-10-27 01:50:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:50:32 [DEBUG   ] Finished updating ant stats in 0.976 seconds
2018-10-27 01:50:37 [DEBUG   ] Got command RPT from MCS: ref #283054
2018-10-27 01:50:37 [DEBUG   ] summary = ERROR
2018-10-27 01:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283054  13 58418  6637573 A  ERRORERROR'
2018-10-27 01:50:37 [DEBUG   ] Got command RPT from MCS: ref #283055
2018-10-27 01:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283055  77 58418  6637574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:50:40 [DEBUG   ] Got command BAM from MCS: ref #283071
2018-10-27 01:50:40 [INFO    ] Finished processing BAM request
2018-10-27 01:50:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283071   8 58418  6640025 A  ERROR'
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:50:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:50:40 [DEBUG   ] spawn_process: at 2018-10-27 01:50:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:50:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:51:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:51:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:51:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 01:51:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2018-10-27 01:51:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:51:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:51:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:51:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:51:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:51:11 [DEBUG   ] Finished updating board flags in 1.352 seconds
2018-10-27 01:51:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 01:51:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 01:51:42 [DEBUG   ] Got command BAM from MCS: ref #283072
2018-10-27 01:51:42 [INFO    ] Finished processing BAM request
2018-10-27 01:51:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283072   8 58418  6702033 A  ERROR'
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 01:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 01:51:42 [DEBUG   ] spawn_process: at 2018-10-27 01:51:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 01:51:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 01:51:54 [DEBUG   ] Got command BAM from MCS: ref #283073
2018-10-27 01:51:54 [INFO    ] Finished processing BAM request
2018-10-27 01:51:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:51:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283073   8 58418  6714029 A  ERROR'
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:51:54 [DEBUG   ] spawn_process: at 2018-10-27 01:51:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:52:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-27 01:52:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-27 01:52:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:52:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 01:52:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:52:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:52:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:52:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:52:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:52:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:52:11 [DEBUG   ] Finished updating board flags in 1.174 seconds
2018-10-27 01:52:12 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 01:52:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 01:52:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 01:52:53 [DEBUG   ] Got command BAM from MCS: ref #283074
2018-10-27 01:52:53 [INFO    ] Finished processing BAM request
2018-10-27 01:52:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:52:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283074   8 58418  6773033 A  ERROR'
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:52:53 [DEBUG   ] spawn_process: at 2018-10-27 01:52:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:53:08 [DEBUG   ] Got command BAM from MCS: ref #283079
2018-10-27 01:53:08 [INFO    ] Finished processing BAM request
2018-10-27 01:53:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:53:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283079   8 58418  6788025 A  ERROR'
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 01:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 01:53:08 [DEBUG   ] spawn_process: at 2018-10-27 01:53:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 01:53:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 01:53:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-27 01:53:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:53:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 01:53:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 01:53:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:53:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:53:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:53:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:53:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:53:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:53:11 [DEBUG   ] Finished updating board flags in 0.992 seconds
2018-10-27 01:53:12 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 01:53:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 01:53:47 [DEBUG   ] Got command RPT from MCS: ref #283082
2018-10-27 01:53:47 [DEBUG   ] summary = ERROR
2018-10-27 01:53:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283082  13 58418  6827849 A  ERRORERROR'
2018-10-27 01:53:48 [DEBUG   ] Got command RPT from MCS: ref #283083
2018-10-27 01:53:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:53:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283083  77 58418  6828053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:53:48 [DEBUG   ] Got command RPT from MCS: ref #283084
2018-10-27 01:53:48 [DEBUG   ] summary = ERROR
2018-10-27 01:53:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283084  13 58418  6828245 A  ERRORERROR'
2018-10-27 01:53:48 [DEBUG   ] Got command RPT from MCS: ref #283086
2018-10-27 01:53:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:53:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283086  77 58418  6828449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:53:48 [DEBUG   ] Got command RPT from MCS: ref #283087
2018-10-27 01:53:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 01:53:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283087  12 58418  6828653 A  ERRORB¢ff'
2018-10-27 01:53:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 01:54:04 [DEBUG   ] Got command BAM from MCS: ref #283092
2018-10-27 01:54:04 [INFO    ] Finished processing BAM request
2018-10-27 01:54:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:54:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283092   8 58418  6844029 A  ERROR'
2018-10-27 01:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 01:54:04 [DEBUG   ] spawn_process: at 2018-10-27 01:54:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 01:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 01:54:05 [DEBUG   ] spawn_process: at 2018-10-27 01:54:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 01:54:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 01:54:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:54:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 01:54:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:54:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:54:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:54:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:54:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:54:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:54:11 [DEBUG   ] Finished updating board flags in 1.268 seconds
2018-10-27 01:54:12 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 01:54:22 [DEBUG   ] Got command BAM from MCS: ref #283093
2018-10-27 01:54:22 [INFO    ] Finished processing BAM request
2018-10-27 01:54:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:54:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283093   8 58418  6862033 A  ERROR'
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:54:22 [DEBUG   ] spawn_process: at 2018-10-27 01:54:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:54:32 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 01:54:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 01:55:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 01:55:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:55:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 01:55:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 01:55:12 [DEBUG   ] Finished updating ant stats in 0.432 seconds
2018-10-27 01:55:12 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:55:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:55:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:55:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:55:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:55:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:55:12 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-10-27 01:55:15 [DEBUG   ] Got command BAM from MCS: ref #283094
2018-10-27 01:55:15 [INFO    ] Finished processing BAM request
2018-10-27 01:55:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:55:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283094   8 58418  6915033 A  ERROR'
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:55:15 [DEBUG   ] spawn_process: at 2018-10-27 01:55:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:55:32 [DEBUG   ] Finished updating ant stats in 0.376 seconds
2018-10-27 01:55:36 [DEBUG   ] Got command BAM from MCS: ref #283095
2018-10-27 01:55:36 [INFO    ] Finished processing BAM request
2018-10-27 01:55:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:55:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283095   8 58418  6936029 A  ERROR'
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:55:36 [DEBUG   ] spawn_process: at 2018-10-27 01:55:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:55:37 [DEBUG   ] Got command RPT from MCS: ref #283096
2018-10-27 01:55:37 [DEBUG   ] summary = ERROR
2018-10-27 01:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283096  13 58418  6937581 A  ERRORERROR'
2018-10-27 01:55:37 [DEBUG   ] Got command RPT from MCS: ref #283097
2018-10-27 01:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283097  77 58418  6937582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:55:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 01:56:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 01:56:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:56:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 01:56:12 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:56:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:56:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:56:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:56:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:56:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:56:12 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-10-27 01:56:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 01:56:27 [DEBUG   ] Got command BAM from MCS: ref #283117
2018-10-27 01:56:27 [INFO    ] Finished processing BAM request
2018-10-27 01:56:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:56:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283117   8 58418  6987029 A  ERROR'
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 01:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 01:56:27 [DEBUG   ] spawn_process: at 2018-10-27 01:56:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 01:56:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:56:51 [DEBUG   ] Got command BAM from MCS: ref #283118
2018-10-27 01:56:51 [INFO    ] Finished processing BAM request
2018-10-27 01:56:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:56:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283118   8 58418  7011029 A  ERROR'
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:56:51 [DEBUG   ] spawn_process: at 2018-10-27 01:56:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:56:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:57:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 01:57:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:57:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-27 01:57:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-27 01:57:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:57:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:57:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:57:11 [WARNING ] (13, 1, 'bot')
2018-10-27 01:57:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:57:11 [DEBUG   ] Finished updating board flags in 0.976 seconds
2018-10-27 01:57:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:57:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:57:39 [DEBUG   ] Got command BAM from MCS: ref #283119
2018-10-27 01:57:39 [INFO    ] Finished processing BAM request
2018-10-27 01:57:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:57:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283119   8 58418  7059025 A  ERROR'
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 01:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 01:57:39 [DEBUG   ] spawn_process: at 2018-10-27 01:57:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 01:57:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 01:58:06 [DEBUG   ] Got command BAM from MCS: ref #283120
2018-10-27 01:58:06 [INFO    ] Finished processing BAM request
2018-10-27 01:58:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:58:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283120   8 58418  7086025 A  ERROR'
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:58:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:58:06 [DEBUG   ] spawn_process: at 2018-10-27 01:58:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:58:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-27 01:58:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:58:12 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:58:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:58:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:58:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:58:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:58:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:58:12 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-10-27 01:58:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 01:58:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 01:58:47 [DEBUG   ] Got command RPT from MCS: ref #283121
2018-10-27 01:58:47 [DEBUG   ] summary = ERROR
2018-10-27 01:58:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283121  13 58418  7127937 A  ERRORERROR'
2018-10-27 01:58:48 [DEBUG   ] Got command RPT from MCS: ref #283122
2018-10-27 01:58:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:58:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283122  77 58418  7128141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:58:48 [DEBUG   ] Got command RPT from MCS: ref #283123
2018-10-27 01:58:48 [DEBUG   ] summary = ERROR
2018-10-27 01:58:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283123  13 58418  7128333 A  ERRORERROR'
2018-10-27 01:58:48 [DEBUG   ] Got command RPT from MCS: ref #283124
2018-10-27 01:58:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 01:58:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283124  77 58418  7128537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 01:58:48 [DEBUG   ] Got command RPT from MCS: ref #283125
2018-10-27 01:58:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 01:58:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283125  12 58418  7128741 A  ERRORB¡ff'
2018-10-27 01:58:51 [DEBUG   ] Got command BAM from MCS: ref #283126
2018-10-27 01:58:51 [INFO    ] Finished processing BAM request
2018-10-27 01:58:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:58:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283126   8 58418  7131025 A  ERROR'
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:58:51 [DEBUG   ] spawn_process: at 2018-10-27 01:58:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:58:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 01:59:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-27 01:59:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 01:59:12 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-27 01:59:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 01:59:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:59:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:59:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:59:12 [WARNING ] (13, 1, 'bot')
2018-10-27 01:59:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 01:59:12 [DEBUG   ] Finished updating board flags in 1.234 seconds
2018-10-27 01:59:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 01:59:21 [DEBUG   ] Got command BAM from MCS: ref #283131
2018-10-27 01:59:21 [INFO    ] Finished processing BAM request
2018-10-27 01:59:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 01:59:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283131   8 58418  7161025 A  ERROR'
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 01:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 01:59:21 [DEBUG   ] spawn_process: at 2018-10-27 01:59:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 01:59:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 01:59:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 02:00:01 [DEBUG   ] Got command BAM from MCS: ref #283132
2018-10-27 02:00:01 [INFO    ] Finished processing BAM request
2018-10-27 02:00:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:00:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283132   8 58418  7201025 A  ERROR'
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 02:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 02:00:01 [DEBUG   ] spawn_process: at 2018-10-27 02:00:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 02:00:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 02:00:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 02:00:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:00:12 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-27 02:00:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 02:00:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:00:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:00:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:00:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:00:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:00:12 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-10-27 02:00:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 02:00:33 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-27 02:00:36 [DEBUG   ] Got command BAM from MCS: ref #283133
2018-10-27 02:00:36 [INFO    ] Finished processing BAM request
2018-10-27 02:00:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:00:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283133   8 58418  7236033 A  ERROR'
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 02:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 02:00:36 [DEBUG   ] spawn_process: at 2018-10-27 02:00:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 02:00:37 [DEBUG   ] Got command RPT from MCS: ref #283134
2018-10-27 02:00:37 [DEBUG   ] summary = ERROR
2018-10-27 02:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283134  13 58418  7237581 A  ERRORERROR'
2018-10-27 02:00:37 [DEBUG   ] Got command RPT from MCS: ref #283135
2018-10-27 02:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283135  77 58418  7237582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:00:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 02:01:09 [DEBUG   ] Got command BAM from MCS: ref #283151
2018-10-27 02:01:09 [INFO    ] Finished processing BAM request
2018-10-27 02:01:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:01:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283151   8 58418  7269033 A  ERROR'
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 02:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 02:01:09 [DEBUG   ] spawn_process: at 2018-10-27 02:01:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 02:01:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:01:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 02:01:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 02:01:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-27 02:01:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:01:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:01:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:01:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:01:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:01:12 [DEBUG   ] Finished updating board flags in 0.988 seconds
2018-10-27 02:01:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 02:01:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 02:01:51 [DEBUG   ] Got command BAM from MCS: ref #283152
2018-10-27 02:01:51 [INFO    ] Finished processing BAM request
2018-10-27 02:01:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:01:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283152   8 58418  7311033 A  ERROR'
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 02:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 02:01:51 [DEBUG   ] spawn_process: at 2018-10-27 02:01:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 02:01:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 02:02:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:02:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-27 02:02:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:02:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:02:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:02:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:02:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:02:12 [DEBUG   ] Finished updating board flags in 1.272 seconds
2018-10-27 02:02:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 02:02:15 [DEBUG   ] Got command BAM from MCS: ref #283157
2018-10-27 02:02:15 [INFO    ] Finished processing BAM request
2018-10-27 02:02:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:02:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283157   8 58418  7335029 A  ERROR'
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-10-27 02:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-10-27 02:02:15 [DEBUG   ] spawn_process: at 2018-10-27 02:02:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-10-27 02:02:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 02:02:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 02:03:06 [DEBUG   ] Got command BAM from MCS: ref #283158
2018-10-27 02:03:06 [INFO    ] Finished processing BAM request
2018-10-27 02:03:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:03:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283158   8 58418  7386033 A  ERROR'
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 02:03:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 02:03:06 [DEBUG   ] spawn_process: at 2018-10-27 02:03:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 02:03:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 02:03:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-27 02:03:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:03:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 02:03:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-27 02:03:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-27 02:03:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:03:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:03:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:03:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:03:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:03:12 [DEBUG   ] Finished updating board flags in 1.165 seconds
2018-10-27 02:03:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 02:03:20 [DEBUG   ] Got command BAM from MCS: ref #283159
2018-10-27 02:03:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283159   8 58418  7400025 A  ERROR'
2018-10-27 02:03:20 [INFO    ] Finished processing BAM request
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 02:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 02:03:20 [DEBUG   ] spawn_process: at 2018-10-27 02:03:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 02:03:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 02:03:48 [DEBUG   ] Got command RPT from MCS: ref #283162
2018-10-27 02:03:48 [DEBUG   ] summary = ERROR
2018-10-27 02:03:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283162  13 58418  7428025 A  ERRORERROR'
2018-10-27 02:03:48 [DEBUG   ] Got command RPT from MCS: ref #283163
2018-10-27 02:03:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:03:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283163  77 58418  7428217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:03:48 [DEBUG   ] Got command RPT from MCS: ref #283164
2018-10-27 02:03:48 [DEBUG   ] summary = ERROR
2018-10-27 02:03:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283164  13 58418  7428421 A  ERRORERROR'
2018-10-27 02:03:48 [DEBUG   ] Got command RPT from MCS: ref #283166
2018-10-27 02:03:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:03:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283166  77 58418  7428625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:03:48 [DEBUG   ] Got command RPT from MCS: ref #283167
2018-10-27 02:03:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 02:03:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283167  12 58418  7428829 A  ERRORB¢ff'
2018-10-27 02:03:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 02:04:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 02:04:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-10-27 02:04:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-27 02:04:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:04:13 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-27 02:04:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 02:04:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:04:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:04:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:04:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:04:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:04:13 [DEBUG   ] Finished updating board flags in 1.600 seconds
2018-10-27 02:04:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 02:04:21 [DEBUG   ] Got command BAM from MCS: ref #283172
2018-10-27 02:04:21 [INFO    ] Finished processing BAM request
2018-10-27 02:04:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:04:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283172   8 58418  7461033 A  ERROR'
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 02:04:21 [DEBUG   ] spawn_process: at 2018-10-27 02:04:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 02:04:23 [DEBUG   ] Got command BAM from MCS: ref #283173
2018-10-27 02:04:23 [INFO    ] Finished processing BAM request
2018-10-27 02:04:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:04:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283173   8 58418  7463029 A  ERROR'
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 02:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 02:04:23 [DEBUG   ] spawn_process: at 2018-10-27 02:04:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 02:04:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 02:04:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 02:05:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-10-27 02:05:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:05:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-27 02:05:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:05:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:05:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:05:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:05:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:05:12 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-10-27 02:05:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 02:05:25 [DEBUG   ] Got command BAM from MCS: ref #283178
2018-10-27 02:05:25 [INFO    ] Finished processing BAM request
2018-10-27 02:05:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:05:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283178   8 58418  7525029 A  ERROR'
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 02:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 02:05:25 [DEBUG   ] spawn_process: at 2018-10-27 02:05:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 02:05:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 02:05:37 [DEBUG   ] Got command BAM from MCS: ref #283179
2018-10-27 02:05:37 [INFO    ] Finished processing BAM request
2018-10-27 02:05:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283179   8 58418  7537033 A  ERROR'
2018-10-27 02:05:37 [DEBUG   ] Got command RPT from MCS: ref #283180
2018-10-27 02:05:37 [DEBUG   ] summary = ERROR
2018-10-27 02:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283180  13 58418  7537573 A  ERRORERROR'
2018-10-27 02:05:37 [DEBUG   ] Got command RPT from MCS: ref #283181
2018-10-27 02:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283181  77 58418  7537574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 02:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 02:05:37 [DEBUG   ] spawn_process: at 2018-10-27 02:05:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 02:05:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 02:06:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:06:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 02:06:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 02:06:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-27 02:06:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:06:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:06:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:06:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:06:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:06:12 [DEBUG   ] Finished updating board flags in 1.030 seconds
2018-10-27 02:06:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 02:06:25 [DEBUG   ] Got command BAM from MCS: ref #283197
2018-10-27 02:06:25 [INFO    ] Finished processing BAM request
2018-10-27 02:06:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:06:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283197   8 58418  7585029 A  ERROR'
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 02:06:25 [DEBUG   ] spawn_process: at 2018-10-27 02:06:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 02:06:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 02:06:53 [DEBUG   ] Got command BAM from MCS: ref #283198
2018-10-27 02:06:53 [INFO    ] Finished processing BAM request
2018-10-27 02:06:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:06:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283198   8 58418  7613033 A  ERROR'
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 02:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 02:06:53 [DEBUG   ] spawn_process: at 2018-10-27 02:06:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 02:06:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 02:06:58 [DEBUG   ] Got command BAM from MCS: ref #283200
2018-10-27 02:06:58 [INFO    ] Finished processing BAM request
2018-10-27 02:06:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:06:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283200   8 58418  7618033 A  ERROR'
2018-10-27 02:06:58 [DEBUG   ] Got command BAM from MCS: ref #283199
2018-10-27 02:06:58 [INFO    ] Finished processing BAM request
2018-10-27 02:06:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:06:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283199   8 58418  7618037 A  ERROR'
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 02:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 02:06:58 [DEBUG   ] spawn_process: at 2018-10-27 02:06:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 02:07:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-27 02:07:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-10-27 02:07:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:07:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-10-27 02:07:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:07:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:07:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:07:12 [WARNING ] (13, 1, 'bot')
2018-10-27 02:07:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:07:12 [DEBUG   ] Finished updating board flags in 0.986 seconds
2018-10-27 02:07:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 02:07:26 [DEBUG   ] Got command BAM from MCS: ref #283203
2018-10-27 02:07:26 [INFO    ] Finished processing BAM request
2018-10-27 02:07:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:07:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283203   8 58418  7646033 A  ERROR'
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 02:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 02:07:26 [DEBUG   ] spawn_process: at 2018-10-27 02:07:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 02:07:31 [DEBUG   ] Got command BAM from MCS: ref #283204
2018-10-27 02:07:31 [INFO    ] Finished processing BAM request
2018-10-27 02:07:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:07:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283204   8 58418  7651029 A  ERROR'
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-10-27 02:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-10-27 02:07:31 [DEBUG   ] spawn_process: at 2018-10-27 02:07:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-10-27 02:07:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 02:07:54 [DEBUG   ] Got command BAM from MCS: ref #283205
2018-10-27 02:07:54 [INFO    ] Finished processing BAM request
2018-10-27 02:07:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:07:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283205   8 58418  7674025 A  ERROR'
2018-10-27 02:07:54 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 02:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 02:07:54 [DEBUG   ] spawn_process: at 2018-10-27 02:07:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 02:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 02:07:55 [DEBUG   ] spawn_process: at 2018-10-27 02:07:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 02:08:05 [DEBUG   ] Got command BAM from MCS: ref #283206
2018-10-27 02:08:05 [INFO    ] Finished processing BAM request
2018-10-27 02:08:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:08:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283206   8 58418  7685025 A  ERROR'
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 02:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 02:08:05 [DEBUG   ] spawn_process: at 2018-10-27 02:08:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 02:08:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-27 02:08:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:08:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 02:08:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 02:08:13 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-10-27 02:08:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-10-27 02:08:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:08:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:08:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:08:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:08:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:08:13 [DEBUG   ] Finished updating board flags in 1.356 seconds
2018-10-27 02:08:14 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 02:08:22 [DEBUG   ] Got command BAM from MCS: ref #283211
2018-10-27 02:08:22 [INFO    ] Finished processing BAM request
2018-10-27 02:08:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283211   8 58418  7702029 A  ERROR'
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-10-27 02:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-10-27 02:08:22 [DEBUG   ] spawn_process: at 2018-10-27 02:08:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-10-27 02:08:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 02:08:39 [DEBUG   ] Got command BAM from MCS: ref #283212
2018-10-27 02:08:39 [INFO    ] Finished processing BAM request
2018-10-27 02:08:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283212   8 58418  7719029 A  ERROR'
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-10-27 02:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-10-27 02:08:39 [DEBUG   ] spawn_process: at 2018-10-27 02:08:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-10-27 02:08:48 [DEBUG   ] Got command RPT from MCS: ref #283213
2018-10-27 02:08:48 [DEBUG   ] summary = ERROR
2018-10-27 02:08:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283213  13 58418  7728113 A  ERRORERROR'
2018-10-27 02:08:48 [DEBUG   ] Got command RPT from MCS: ref #283214
2018-10-27 02:08:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:08:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283214  77 58418  7728317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:08:48 [DEBUG   ] Got command RPT from MCS: ref #283215
2018-10-27 02:08:48 [DEBUG   ] summary = ERROR
2018-10-27 02:08:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283215  13 58418  7728509 A  ERRORERROR'
2018-10-27 02:08:48 [DEBUG   ] Got command RPT from MCS: ref #283216
2018-10-27 02:08:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:08:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283216  77 58418  7728713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:08:48 [DEBUG   ] Got command RPT from MCS: ref #283217
2018-10-27 02:08:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 02:08:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283217  12 58418  7728917 A  ERRORB¡ff'
2018-10-27 02:08:50 [DEBUG   ] Got command BAM from MCS: ref #283218
2018-10-27 02:08:50 [INFO    ] Finished processing BAM request
2018-10-27 02:08:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-10-27 02:08:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   283218   8 58418  7730025 A  ERROR'
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 02:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 02:08:50 [DEBUG   ] spawn_process: at 2018-10-27 02:08:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 02:08:54 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 02:09:00 [DEBUG   ] Got command STP from MCS: ref #283219
2018-10-27 02:09:00 [INFO    ] Finished processing BAM request
2018-10-27 02:09:00 [INFO    ] Shutdown the adder chain on beam #4
2018-10-27 02:09:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   283219   8 58418  7740033 A  ERROR'
2018-10-27 02:09:00 [DEBUG   ] Got command STP from MCS: ref #283220
2018-10-27 02:09:00 [INFO    ] Finished processing BAM request
2018-10-27 02:09:00 [INFO    ] Shutdown the adder chain on beam #2
2018-10-27 02:09:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   283220   8 58418  7740037 A  ERROR'
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-10-27 02:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-10-27 02:09:00 [DEBUG   ] spawn_process: at 2018-10-27 02:09:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-10-27 02:09:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:09:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:09:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:09:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:09:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:09:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:09:13 [DEBUG   ] Finished updating board flags in 1.205 seconds
2018-10-27 02:09:14 [DEBUG   ] Finished updating ant stats in 0.395 seconds
2018-10-27 02:09:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 02:09:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 02:10:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:10:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:10:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:10:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:10:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:10:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:10:13 [DEBUG   ] Finished updating board flags in 1.224 seconds
2018-10-27 02:10:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 02:10:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 02:10:37 [DEBUG   ] Got command RPT from MCS: ref #283221
2018-10-27 02:10:37 [DEBUG   ] summary = ERROR
2018-10-27 02:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283221  13 58418  7837585 A  ERRORERROR'
2018-10-27 02:10:37 [DEBUG   ] Got command RPT from MCS: ref #283222
2018-10-27 02:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283222  77 58418  7837586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:10:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 02:11:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-27 02:11:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:11:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:11:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:11:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:11:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:11:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:11:13 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-10-27 02:11:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 02:11:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 02:11:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 02:12:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:12:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:12:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:12:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:12:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:12:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:12:13 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-10-27 02:12:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 02:12:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 02:12:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 02:13:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:13:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:13:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:13:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:13:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:13:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:13:13 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-10-27 02:13:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 02:13:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 02:13:48 [DEBUG   ] Got command RPT from MCS: ref #283244
2018-10-27 02:13:48 [DEBUG   ] summary = ERROR
2018-10-27 02:13:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283244  13 58418  8028193 A  ERRORERROR'
2018-10-27 02:13:48 [DEBUG   ] Got command RPT from MCS: ref #283245
2018-10-27 02:13:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:13:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283245  77 58418  8028397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:13:48 [DEBUG   ] Got command RPT from MCS: ref #283246
2018-10-27 02:13:48 [DEBUG   ] summary = ERROR
2018-10-27 02:13:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283246  13 58418  8028601 A  ERRORERROR'
2018-10-27 02:13:48 [DEBUG   ] Got command RPT from MCS: ref #283248
2018-10-27 02:13:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:13:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283248  77 58418  8028793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:13:48 [DEBUG   ] Got command RPT from MCS: ref #283249
2018-10-27 02:13:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 02:13:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283249  12 58418  8028997 A  ERRORB™™š'
2018-10-27 02:13:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 02:14:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:14:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:14:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:14:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:14:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:14:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:14:13 [DEBUG   ] Finished updating board flags in 0.983 seconds
2018-10-27 02:14:15 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-27 02:14:35 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-27 02:14:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 02:15:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:15:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:15:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:15:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:15:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:15:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:15:13 [DEBUG   ] Finished updating board flags in 1.279 seconds
2018-10-27 02:15:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 02:15:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 02:15:37 [DEBUG   ] Got command RPT from MCS: ref #283258
2018-10-27 02:15:37 [DEBUG   ] summary = ERROR
2018-10-27 02:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283258  13 58418  8137585 A  ERRORERROR'
2018-10-27 02:15:37 [DEBUG   ] Got command RPT from MCS: ref #283259
2018-10-27 02:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283259  77 58418  8137586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:15:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 02:16:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:16:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:16:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:16:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:16:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:16:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:16:13 [DEBUG   ] Finished updating board flags in 1.193 seconds
2018-10-27 02:16:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 02:16:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 02:16:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 02:17:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:17:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:17:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:17:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:17:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:17:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:17:13 [DEBUG   ] Finished updating board flags in 1.002 seconds
2018-10-27 02:17:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 02:17:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 02:17:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 02:18:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:18:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 02:18:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:18:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:18:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:18:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:18:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:18:13 [DEBUG   ] Finished updating board flags in 1.040 seconds
2018-10-27 02:18:16 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-10-27 02:18:36 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-27 02:18:48 [DEBUG   ] Got command RPT from MCS: ref #283279
2018-10-27 02:18:48 [DEBUG   ] summary = ERROR
2018-10-27 02:18:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283279  13 58418  8328281 A  ERRORERROR'
2018-10-27 02:18:48 [DEBUG   ] Got command RPT from MCS: ref #283280
2018-10-27 02:18:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:18:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283280  77 58418  8328485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:18:48 [DEBUG   ] Got command RPT from MCS: ref #283281
2018-10-27 02:18:48 [DEBUG   ] summary = ERROR
2018-10-27 02:18:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283281  13 58418  8328689 A  ERRORERROR'
2018-10-27 02:18:48 [DEBUG   ] Got command RPT from MCS: ref #283282
2018-10-27 02:18:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:18:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283282  77 58418  8328881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:18:49 [DEBUG   ] Got command RPT from MCS: ref #283283
2018-10-27 02:18:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 02:18:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283283  12 58418  8329085 A  ERRORB˜™š'
2018-10-27 02:18:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 02:19:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:19:13 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 02:19:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:19:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:19:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:19:13 [WARNING ] (13, 1, 'bot')
2018-10-27 02:19:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:19:13 [DEBUG   ] Finished updating board flags in 0.937 seconds
2018-10-27 02:19:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 02:19:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 02:19:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 02:20:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:20:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:20:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:20:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:20:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:20:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:20:14 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-10-27 02:20:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 02:20:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 02:20:37 [DEBUG   ] Got command RPT from MCS: ref #283288
2018-10-27 02:20:37 [DEBUG   ] summary = ERROR
2018-10-27 02:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283288  13 58418  8437581 A  ERRORERROR'
2018-10-27 02:20:37 [DEBUG   ] Got command RPT from MCS: ref #283289
2018-10-27 02:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283289  77 58418  8437582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:20:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 02:21:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:21:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:21:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:21:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:21:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:21:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:21:14 [DEBUG   ] Finished updating board flags in 1.202 seconds
2018-10-27 02:21:17 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 02:21:37 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-27 02:21:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 02:22:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:22:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:22:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:22:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:22:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:22:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:22:14 [DEBUG   ] Finished updating board flags in 1.196 seconds
2018-10-27 02:22:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 02:22:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 02:22:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 02:23:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:23:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:23:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:23:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:23:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:23:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:23:14 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-10-27 02:23:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 02:23:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 02:23:48 [DEBUG   ] Got command RPT from MCS: ref #283311
2018-10-27 02:23:48 [DEBUG   ] summary = ERROR
2018-10-27 02:23:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283311  13 58418  8628361 A  ERRORERROR'
2018-10-27 02:23:48 [DEBUG   ] Got command RPT from MCS: ref #283312
2018-10-27 02:23:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:23:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283312  77 58418  8628565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:23:48 [DEBUG   ] Got command RPT from MCS: ref #283313
2018-10-27 02:23:48 [DEBUG   ] summary = ERROR
2018-10-27 02:23:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283313  13 58418  8628769 A  ERRORERROR'
2018-10-27 02:23:48 [DEBUG   ] Got command RPT from MCS: ref #283314
2018-10-27 02:23:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:23:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283314  77 58418  8628973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:23:49 [DEBUG   ] Got command RPT from MCS: ref #283316
2018-10-27 02:23:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 02:23:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283316  12 58418  8629165 A  ERRORB™™š'
2018-10-27 02:23:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 02:24:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:24:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 02:24:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:24:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:24:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:24:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:24:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:24:14 [DEBUG   ] Finished updating board flags in 0.991 seconds
2018-10-27 02:24:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 02:24:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 02:24:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 02:25:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:25:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 02:25:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:25:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:25:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:25:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:25:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:25:14 [DEBUG   ] Finished updating board flags in 1.267 seconds
2018-10-27 02:25:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 02:25:37 [DEBUG   ] Got command RPT from MCS: ref #283321
2018-10-27 02:25:37 [DEBUG   ] summary = ERROR
2018-10-27 02:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283321  13 58418  8737581 A  ERRORERROR'
2018-10-27 02:25:37 [DEBUG   ] Got command RPT from MCS: ref #283322
2018-10-27 02:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283322  77 58418  8737582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:25:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 02:25:58 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 02:26:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:26:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:26:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:26:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:26:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:26:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:26:14 [DEBUG   ] Finished updating board flags in 1.188 seconds
2018-10-27 02:26:18 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 02:26:38 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-27 02:26:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 02:27:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:27:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:27:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:27:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:27:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:27:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:27:14 [DEBUG   ] Finished updating board flags in 1.004 seconds
2018-10-27 02:27:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 02:27:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 02:27:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 02:28:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:28:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:28:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:28:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:28:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:28:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:28:14 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-10-27 02:28:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 02:28:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 02:28:48 [DEBUG   ] Got command RPT from MCS: ref #283342
2018-10-27 02:28:48 [DEBUG   ] summary = ERROR
2018-10-27 02:28:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283342  13 58418  8928449 A  ERRORERROR'
2018-10-27 02:28:48 [DEBUG   ] Got command RPT from MCS: ref #283343
2018-10-27 02:28:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:28:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283343  77 58418  8928653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:28:48 [DEBUG   ] Got command RPT from MCS: ref #283344
2018-10-27 02:28:48 [DEBUG   ] summary = ERROR
2018-10-27 02:28:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283344  13 58418  8928857 A  ERRORERROR'
2018-10-27 02:28:49 [DEBUG   ] Got command RPT from MCS: ref #283345
2018-10-27 02:28:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:28:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283345  77 58418  8929049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:28:49 [DEBUG   ] Got command RPT from MCS: ref #283346
2018-10-27 02:28:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 02:28:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283346  12 58418  8929253 A  ERRORB˜™š'
2018-10-27 02:28:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 02:29:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:29:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:29:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:29:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:29:14 [WARNING ] (13, 1, 'bot')
2018-10-27 02:29:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:29:14 [DEBUG   ] Finished updating board flags in 0.993 seconds
2018-10-27 02:29:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 02:29:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 02:29:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 02:30:00 [DEBUG   ] Got command TBN from MCS: ref #283351
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-27 02:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   283351   8 58418  9000821 A  ERROR'
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540607402']
2018-10-27 02:30:00 [DEBUG   ] spawn_process: at 2018-10-27 02:30:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540607402']
2018-10-27 02:30:00 [INFO    ] Finished spawning TBN in 0.050 s
2018-10-27 02:30:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:30:15 [WARNING ] (13, 1, 'bot')
2018-10-27 02:30:15 [WARNING ] (13, 1, 'bot')
2018-10-27 02:30:15 [WARNING ] (13, 1, 'bot')
2018-10-27 02:30:15 [WARNING ] (13, 1, 'bot')
2018-10-27 02:30:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:30:15 [DEBUG   ] Finished updating board flags in 1.565 seconds
2018-10-27 02:30:19 [DEBUG   ] Finished updating ant stats in 0.668 seconds
2018-10-27 02:30:37 [DEBUG   ] Got command RPT from MCS: ref #283352
2018-10-27 02:30:37 [DEBUG   ] summary = ERROR
2018-10-27 02:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283352  13 58418  9037581 A  ERRORERROR'
2018-10-27 02:30:37 [DEBUG   ] Got command RPT from MCS: ref #283353
2018-10-27 02:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283353  77 58418  9037582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:30:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 02:30:59 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 02:31:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:31:15 [WARNING ] (13, 1, 'bot')
2018-10-27 02:31:15 [WARNING ] (13, 1, 'bot')
2018-10-27 02:31:15 [WARNING ] (13, 1, 'bot')
2018-10-27 02:31:15 [WARNING ] (13, 1, 'bot')
2018-10-27 02:31:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:31:15 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-10-27 02:31:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 02:31:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 02:31:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 02:32:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:32:15 [WARNING ] (13, 1, 'bot')
2018-10-27 02:32:15 [WARNING ] (13, 1, 'bot')
2018-10-27 02:32:15 [WARNING ] (13, 1, 'bot')
2018-10-27 02:32:15 [WARNING ] (13, 1, 'bot')
2018-10-27 02:32:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:32:15 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-10-27 02:32:19 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 02:32:40 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-27 02:32:59 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 02:33:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:33:15 [WARNING ] (13, 1, 'bot')
2018-10-27 02:33:15 [WARNING ] (13, 1, 'bot')
2018-10-27 02:33:15 [WARNING ] (13, 1, 'bot')
2018-10-27 02:33:15 [WARNING ] (13, 1, 'bot')
2018-10-27 02:33:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:33:15 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-10-27 02:33:19 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-27 02:33:40 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-27 02:33:48 [DEBUG   ] Got command RPT from MCS: ref #283375
2018-10-27 02:33:48 [DEBUG   ] summary = ERROR
2018-10-27 02:33:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283375  13 58418  9228537 A  ERRORERROR'
2018-10-27 02:33:48 [DEBUG   ] Got command RPT from MCS: ref #283376
2018-10-27 02:33:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:33:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283376  77 58418  9228741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:33:48 [DEBUG   ] Got command RPT from MCS: ref #283377
2018-10-27 02:33:48 [DEBUG   ] summary = ERROR
2018-10-27 02:33:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283377  13 58418  9228933 A  ERRORERROR'
2018-10-27 02:33:49 [DEBUG   ] Got command RPT from MCS: ref #283379
2018-10-27 02:33:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:33:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283379  77 58418  9229137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:33:49 [DEBUG   ] Got command RPT from MCS: ref #283380
2018-10-27 02:33:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 02:33:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283380  12 58418  9229341 A  ERRORB—™š'
2018-10-27 02:34:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 02:34:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:34:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:34:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:34:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:34:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:34:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:34:16 [DEBUG   ] Finished updating board flags in 2.224 seconds
2018-10-27 02:34:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 02:34:40 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-10-27 02:35:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 02:35:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:35:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 02:35:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:35:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:35:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:35:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:35:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:35:16 [DEBUG   ] Finished updating board flags in 2.153 seconds
2018-10-27 02:35:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 02:35:37 [DEBUG   ] Got command RPT from MCS: ref #283389
2018-10-27 02:35:37 [DEBUG   ] summary = ERROR
2018-10-27 02:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283389  13 58418  9337589 A  ERRORERROR'
2018-10-27 02:35:37 [DEBUG   ] Got command RPT from MCS: ref #283390
2018-10-27 02:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283390  77 58418  9337590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:35:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 02:36:00 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 02:36:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:36:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:36:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:36:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:36:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:36:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:36:16 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-10-27 02:36:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 02:36:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 02:37:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 02:37:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:37:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 02:37:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:37:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:37:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:37:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:37:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:37:16 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-10-27 02:37:20 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-27 02:37:41 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-27 02:38:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 02:38:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:38:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 02:38:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:38:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:38:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:38:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:38:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:38:16 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-10-27 02:38:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 02:38:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 02:38:48 [DEBUG   ] Got command RPT from MCS: ref #283410
2018-10-27 02:38:48 [DEBUG   ] summary = ERROR
2018-10-27 02:38:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283410  13 58418  9528625 A  ERRORERROR'
2018-10-27 02:38:48 [DEBUG   ] Got command RPT from MCS: ref #283411
2018-10-27 02:38:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:38:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283411  77 58418  9528829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:38:49 [DEBUG   ] Got command RPT from MCS: ref #283412
2018-10-27 02:38:49 [DEBUG   ] summary = ERROR
2018-10-27 02:38:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283412  13 58418  9529021 A  ERRORERROR'
2018-10-27 02:38:49 [DEBUG   ] Got command RPT from MCS: ref #283413
2018-10-27 02:38:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:38:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283413  77 58418  9529225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:38:49 [DEBUG   ] Got command RPT from MCS: ref #283414
2018-10-27 02:38:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 02:38:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283414  12 58418  9529429 A  ERRORB˜™š'
2018-10-27 02:39:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 02:39:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 02:39:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:39:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:39:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:39:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:39:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:39:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:39:16 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-27 02:39:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 02:39:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 02:40:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 02:40:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:40:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:40:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:40:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:40:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:40:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:40:16 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-10-27 02:40:21 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-27 02:40:37 [DEBUG   ] Got command RPT from MCS: ref #283415
2018-10-27 02:40:37 [DEBUG   ] summary = ERROR
2018-10-27 02:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283415  13 58418  9637581 A  ERRORERROR'
2018-10-27 02:40:37 [DEBUG   ] Got command RPT from MCS: ref #283416
2018-10-27 02:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283416  77 58418  9637582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:40:41 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 02:41:02 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-27 02:41:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:41:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:41:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:41:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:41:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:41:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:41:16 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-27 02:41:21 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-27 02:41:42 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 02:42:02 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 02:42:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:42:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:42:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:42:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:42:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:42:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:42:16 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-10-27 02:42:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 02:42:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 02:43:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 02:43:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:43:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:43:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:43:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:43:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:43:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:43:16 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-27 02:43:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 02:43:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 02:43:48 [DEBUG   ] Got command RPT from MCS: ref #283438
2018-10-27 02:43:48 [DEBUG   ] summary = ERROR
2018-10-27 02:43:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283438  13 58418  9828701 A  ERRORERROR'
2018-10-27 02:43:48 [DEBUG   ] Got command RPT from MCS: ref #283439
2018-10-27 02:43:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:43:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283439  77 58418  9828905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:43:49 [DEBUG   ] Got command RPT from MCS: ref #283440
2018-10-27 02:43:49 [DEBUG   ] summary = ERROR
2018-10-27 02:43:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283440  13 58418  9829109 A  ERRORERROR'
2018-10-27 02:43:49 [DEBUG   ] Got command RPT from MCS: ref #283442
2018-10-27 02:43:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:43:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283442  77 58418  9829313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:43:49 [DEBUG   ] Got command RPT from MCS: ref #283443
2018-10-27 02:43:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 02:43:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283443  12 58418  9829505 A  ERRORB™™š'
2018-10-27 02:44:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 02:44:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:44:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:44:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:44:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:44:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:44:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:44:16 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-10-27 02:44:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 02:44:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 02:45:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 02:45:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:45:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 02:45:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:45:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:45:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:45:16 [WARNING ] (13, 1, 'bot')
2018-10-27 02:45:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:45:16 [DEBUG   ] Finished updating board flags in 1.351 seconds
2018-10-27 02:45:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 02:45:37 [DEBUG   ] Got command RPT from MCS: ref #283452
2018-10-27 02:45:37 [DEBUG   ] summary = ERROR
2018-10-27 02:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283452  13 58418  9937593 A  ERRORERROR'
2018-10-27 02:45:37 [DEBUG   ] Got command RPT from MCS: ref #283453
2018-10-27 02:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283453  77 58418  9937594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:45:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 02:46:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 02:46:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 02:46:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:46:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:46:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:46:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:46:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:46:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:46:17 [DEBUG   ] Finished updating board flags in 2.072 seconds
2018-10-27 02:46:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 02:46:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 02:47:02 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 02:47:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:47:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:47:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:47:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:47:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:47:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:47:17 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-10-27 02:47:22 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-27 02:47:43 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 02:48:03 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 02:48:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:48:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 02:48:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:48:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:48:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:48:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:48:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:48:17 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-27 02:48:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 02:48:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 02:48:48 [DEBUG   ] Got command RPT from MCS: ref #283473
2018-10-27 02:48:48 [DEBUG   ] summary = ERROR
2018-10-27 02:48:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283473  13 58418 10128793 A  ERRORERROR'
2018-10-27 02:48:48 [DEBUG   ] Got command RPT from MCS: ref #283474
2018-10-27 02:48:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:48:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283474  77 58418 10128997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:48:49 [DEBUG   ] Got command RPT from MCS: ref #283475
2018-10-27 02:48:49 [DEBUG   ] summary = ERROR
2018-10-27 02:48:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283475  13 58418 10129189 A  ERRORERROR'
2018-10-27 02:48:49 [DEBUG   ] Got command RPT from MCS: ref #283476
2018-10-27 02:48:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:48:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283476  77 58418 10129393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:48:49 [DEBUG   ] Got command RPT from MCS: ref #283477
2018-10-27 02:48:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 02:48:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283477  12 58418 10129597 A  ERRORB™™š'
2018-10-27 02:49:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 02:49:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:49:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:49:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:49:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:49:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:49:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:49:17 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-10-27 02:49:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 02:49:43 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 02:50:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 02:50:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 02:50:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:50:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:50:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:50:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:50:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:50:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:50:17 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-27 02:50:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 02:50:37 [DEBUG   ] Got command RPT from MCS: ref #283482
2018-10-27 02:50:37 [DEBUG   ] summary = ERROR
2018-10-27 02:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283482  13 58418 10237589 A  ERRORERROR'
2018-10-27 02:50:37 [DEBUG   ] Got command RPT from MCS: ref #283483
2018-10-27 02:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283483  77 58418 10237590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:50:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 02:51:03 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-10-27 02:51:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:51:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:51:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:51:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:51:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:51:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:51:17 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-10-27 02:51:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 02:51:44 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 02:52:04 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-10-27 02:52:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:52:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:52:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:52:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:52:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:52:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:52:17 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-27 02:52:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 02:52:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 02:53:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 02:53:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:53:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:53:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:53:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:53:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:53:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:53:17 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-10-27 02:53:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 02:53:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 02:53:48 [DEBUG   ] Got command RPT from MCS: ref #283505
2018-10-27 02:53:48 [DEBUG   ] summary = ERROR
2018-10-27 02:53:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283505  13 58418 10428877 A  ERRORERROR'
2018-10-27 02:53:49 [DEBUG   ] Got command RPT from MCS: ref #283506
2018-10-27 02:53:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:53:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283506  77 58418 10429081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:53:49 [DEBUG   ] Got command RPT from MCS: ref #283507
2018-10-27 02:53:49 [DEBUG   ] summary = ERROR
2018-10-27 02:53:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283507  13 58418 10429273 A  ERRORERROR'
2018-10-27 02:53:49 [DEBUG   ] Got command RPT from MCS: ref #283509
2018-10-27 02:53:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:53:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283509  77 58418 10429477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:53:49 [DEBUG   ] Got command RPT from MCS: ref #283510
2018-10-27 02:53:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 02:53:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283510  12 58418 10429681 A  ERRORB˜™š'
2018-10-27 02:54:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 02:54:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 02:54:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:54:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:54:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:54:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:54:17 [WARNING ] (13, 1, 'bot')
2018-10-27 02:54:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:54:17 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-10-27 02:54:24 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 02:54:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 02:55:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 02:55:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:55:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-27 02:55:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:55:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:55:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:55:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:55:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:55:18 [DEBUG   ] Finished updating board flags in 2.219 seconds
2018-10-27 02:55:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 02:55:37 [DEBUG   ] Got command RPT from MCS: ref #283515
2018-10-27 02:55:37 [DEBUG   ] summary = ERROR
2018-10-27 02:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283515  13 58418 10537589 A  ERRORERROR'
2018-10-27 02:55:37 [DEBUG   ] Got command RPT from MCS: ref #283516
2018-10-27 02:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283516  77 58418 10537590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:55:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 02:56:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 02:56:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:56:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:56:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:56:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:56:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:56:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:56:18 [DEBUG   ] Finished updating board flags in 2.178 seconds
2018-10-27 02:56:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 02:56:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 02:57:04 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 02:57:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:57:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:57:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:57:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:57:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:57:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:57:18 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-10-27 02:57:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 02:57:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 02:58:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 02:58:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:58:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-10-27 02:58:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:58:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:58:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:58:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:58:18 [WARNING ] (25, 5, 'bot')
2018-10-27 02:58:18 [WARNING ] (25, 5, 'bot')
2018-10-27 02:58:18 [WARNING ] (25, 5, 'bot')
2018-10-27 02:58:18 [WARNING ] (25, 5, 'bot')
2018-10-27 02:58:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:58:18 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-10-27 02:58:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 02:58:44 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-10-27 02:58:48 [DEBUG   ] Got command RPT from MCS: ref #283536
2018-10-27 02:58:48 [DEBUG   ] summary = ERROR
2018-10-27 02:58:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283536  13 58418 10728965 A  ERRORERROR'
2018-10-27 02:58:49 [DEBUG   ] Got command RPT from MCS: ref #283537
2018-10-27 02:58:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:58:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283537  77 58418 10729169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:58:49 [DEBUG   ] Got command RPT from MCS: ref #283538
2018-10-27 02:58:49 [DEBUG   ] summary = ERROR
2018-10-27 02:58:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283538  13 58418 10729373 A  ERRORERROR'
2018-10-27 02:58:49 [DEBUG   ] Got command RPT from MCS: ref #283539
2018-10-27 02:58:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 02:58:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283539  77 58418 10729565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 02:58:49 [DEBUG   ] Got command RPT from MCS: ref #283540
2018-10-27 02:58:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 02:58:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283540  12 58418 10729769 A  ERRORB˜™š'
2018-10-27 02:59:05 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 02:59:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 02:59:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:59:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:59:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:59:18 [WARNING ] (13, 1, 'bot')
2018-10-27 02:59:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 02:59:18 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-10-27 02:59:25 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 02:59:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 03:00:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 03:00:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:00:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:00:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:00:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:00:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:00:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:00:18 [DEBUG   ] Finished updating board flags in 1.934 seconds
2018-10-27 03:00:25 [DEBUG   ] Finished updating ant stats in 1.192 seconds
2018-10-27 03:00:37 [DEBUG   ] Got command RPT from MCS: ref #283545
2018-10-27 03:00:37 [DEBUG   ] summary = ERROR
2018-10-27 03:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283545  13 58418 10837593 A  ERRORERROR'
2018-10-27 03:00:37 [DEBUG   ] Got command RPT from MCS: ref #283546
2018-10-27 03:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283546  77 58418 10837594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:00:45 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 03:01:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 03:01:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:01:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:01:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:01:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:01:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:01:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:01:18 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-10-27 03:01:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 03:01:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 03:02:05 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-10-27 03:02:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:02:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:02:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:02:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:02:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:02:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:02:18 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-10-27 03:02:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 03:02:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 03:03:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 03:03:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:03:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:03:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:03:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:03:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:03:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:03:18 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-10-27 03:03:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 03:03:45 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-10-27 03:03:49 [DEBUG   ] Got command RPT from MCS: ref #283568
2018-10-27 03:03:49 [DEBUG   ] summary = ERROR
2018-10-27 03:03:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283568  13 58418 11029053 A  ERRORERROR'
2018-10-27 03:03:49 [DEBUG   ] Got command RPT from MCS: ref #283569
2018-10-27 03:03:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:03:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283569  77 58418 11029257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:03:49 [DEBUG   ] Got command RPT from MCS: ref #283570
2018-10-27 03:03:49 [DEBUG   ] summary = ERROR
2018-10-27 03:03:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283570  13 58418 11029449 A  ERRORERROR'
2018-10-27 03:03:49 [DEBUG   ] Got command RPT from MCS: ref #283572
2018-10-27 03:03:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:03:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283572  77 58418 11029653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:03:49 [DEBUG   ] Got command RPT from MCS: ref #283574
2018-10-27 03:03:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 03:03:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283574  12 58418 11029857 A  ERRORB—™š'
2018-10-27 03:04:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 03:04:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:04:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:04:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:04:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:04:18 [WARNING ] (13, 1, 'bot')
2018-10-27 03:04:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:04:18 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-10-27 03:04:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 03:04:46 [DEBUG   ] Finished updating ant stats in 1.405 seconds
2018-10-27 03:05:06 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 03:05:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:05:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:05:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:05:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:05:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:05:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:05:19 [DEBUG   ] Finished updating board flags in 2.207 seconds
2018-10-27 03:05:26 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 03:05:37 [DEBUG   ] Got command RPT from MCS: ref #283582
2018-10-27 03:05:37 [DEBUG   ] summary = ERROR
2018-10-27 03:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283582  13 58418 11137589 A  ERRORERROR'
2018-10-27 03:05:37 [DEBUG   ] Got command RPT from MCS: ref #283583
2018-10-27 03:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283583  77 58418 11137590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:05:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 03:06:06 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-27 03:06:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:06:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:06:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:06:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:06:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:06:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:06:19 [DEBUG   ] Finished updating board flags in 2.184 seconds
2018-10-27 03:06:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 03:06:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 03:07:06 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 03:07:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:07:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:07:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:07:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:07:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:07:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:07:19 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-10-27 03:07:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 03:07:46 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-10-27 03:08:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 03:08:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 03:08:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:08:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:08:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:08:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:08:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:08:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:08:19 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-10-27 03:08:26 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 03:08:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 03:08:49 [DEBUG   ] Got command RPT from MCS: ref #283603
2018-10-27 03:08:49 [DEBUG   ] summary = ERROR
2018-10-27 03:08:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283603  13 58418 11329137 A  ERRORERROR'
2018-10-27 03:08:49 [DEBUG   ] Got command RPT from MCS: ref #283604
2018-10-27 03:08:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:08:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283604  77 58418 11329341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:08:49 [DEBUG   ] Got command RPT from MCS: ref #283605
2018-10-27 03:08:49 [DEBUG   ] summary = ERROR
2018-10-27 03:08:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283605  13 58418 11329545 A  ERRORERROR'
2018-10-27 03:08:49 [DEBUG   ] Got command RPT from MCS: ref #283606
2018-10-27 03:08:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:08:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283606  77 58418 11329737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:08:49 [DEBUG   ] Got command RPT from MCS: ref #283607
2018-10-27 03:08:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 03:08:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283607  12 58418 11329941 A  ERRORB™™š'
2018-10-27 03:09:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 03:09:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:09:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:09:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:09:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:09:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:09:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:09:19 [DEBUG   ] Finished updating board flags in 1.848 seconds
2018-10-27 03:09:26 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 03:09:47 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 03:10:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 03:10:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:10:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:10:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:10:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:10:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:10:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:10:19 [DEBUG   ] Finished updating board flags in 1.759 seconds
2018-10-27 03:10:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 03:10:37 [DEBUG   ] Got command RPT from MCS: ref #283608
2018-10-27 03:10:37 [DEBUG   ] summary = ERROR
2018-10-27 03:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283608  13 58418 11437601 A  ERRORERROR'
2018-10-27 03:10:37 [DEBUG   ] Got command RPT from MCS: ref #283609
2018-10-27 03:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283609  77 58418 11437602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:10:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 03:11:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 03:11:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:11:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:11:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:11:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:11:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:11:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:11:19 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-10-27 03:11:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 03:11:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 03:12:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 03:12:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 03:12:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:12:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 03:12:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:12:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:12:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:12:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:12:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:12:19 [DEBUG   ] Finished updating board flags in 1.573 seconds
2018-10-27 03:12:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 03:12:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 03:13:07 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 03:13:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:13:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:13:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:13:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:13:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:13:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:13:19 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-27 03:13:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 03:13:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 03:13:49 [DEBUG   ] Got command RPT from MCS: ref #283631
2018-10-27 03:13:49 [DEBUG   ] summary = ERROR
2018-10-27 03:13:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283631  13 58418 11629229 A  ERRORERROR'
2018-10-27 03:13:49 [DEBUG   ] Got command RPT from MCS: ref #283632
2018-10-27 03:13:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:13:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283632  77 58418 11629433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:13:49 [DEBUG   ] Got command RPT from MCS: ref #283633
2018-10-27 03:13:49 [DEBUG   ] summary = ERROR
2018-10-27 03:13:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283633  13 58418 11629625 A  ERRORERROR'
2018-10-27 03:13:49 [DEBUG   ] Got command RPT from MCS: ref #283635
2018-10-27 03:13:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:13:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283635  77 58418 11629829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:13:50 [DEBUG   ] Got command RPT from MCS: ref #283636
2018-10-27 03:13:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 03:13:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283636  12 58418 11630033 A  ERRORB™™š'
2018-10-27 03:14:07 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-27 03:14:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:14:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:14:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:14:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:14:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:14:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:14:19 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-10-27 03:14:28 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-27 03:14:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 03:15:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 03:15:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:15:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:15:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:15:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:15:19 [WARNING ] (13, 1, 'bot')
2018-10-27 03:15:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:15:19 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-10-27 03:15:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 03:15:37 [DEBUG   ] Got command RPT from MCS: ref #283645
2018-10-27 03:15:37 [DEBUG   ] summary = ERROR
2018-10-27 03:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283645  13 58418 11737593 A  ERRORERROR'
2018-10-27 03:15:37 [DEBUG   ] Got command RPT from MCS: ref #283646
2018-10-27 03:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283646  77 58418 11737594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:15:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 03:16:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 03:16:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:16:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:16:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:16:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:16:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:16:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:16:20 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-10-27 03:16:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 03:16:48 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-10-27 03:17:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 03:17:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 03:17:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:17:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:17:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:17:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:17:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:17:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:17:20 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-10-27 03:17:28 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-10-27 03:17:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 03:18:09 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-27 03:18:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:18:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:18:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:18:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:18:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:18:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:18:20 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-10-27 03:18:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 03:18:49 [DEBUG   ] Got command RPT from MCS: ref #283666
2018-10-27 03:18:49 [DEBUG   ] summary = ERROR
2018-10-27 03:18:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283666  13 58418 11929314 A  ERRORERROR'
2018-10-27 03:18:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 03:18:49 [DEBUG   ] Got command RPT from MCS: ref #283667
2018-10-27 03:18:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:18:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283667  77 58418 11929517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:18:49 [DEBUG   ] Got command RPT from MCS: ref #283668
2018-10-27 03:18:49 [DEBUG   ] summary = ERROR
2018-10-27 03:18:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283668  13 58418 11929721 A  ERRORERROR'
2018-10-27 03:18:49 [DEBUG   ] Got command RPT from MCS: ref #283669
2018-10-27 03:18:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:18:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283669  77 58418 11929913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:18:50 [DEBUG   ] Got command RPT from MCS: ref #283670
2018-10-27 03:18:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 03:18:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283670  12 58418 11930117 A  ERRORB˜™š'
2018-10-27 03:19:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 03:19:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:19:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:19:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:19:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:19:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:19:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:19:20 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-27 03:19:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 03:19:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 03:20:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 03:20:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:20:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:20:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:20:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:20:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:20:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:20:20 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-10-27 03:20:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 03:20:37 [DEBUG   ] Got command RPT from MCS: ref #283675
2018-10-27 03:20:37 [DEBUG   ] summary = ERROR
2018-10-27 03:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283675  13 58418 12037593 A  ERRORERROR'
2018-10-27 03:20:37 [DEBUG   ] Got command RPT from MCS: ref #283676
2018-10-27 03:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283676  77 58418 12037594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:20:49 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-10-27 03:21:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 03:21:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:21:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:21:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:21:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:21:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:21:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:21:20 [DEBUG   ] Finished updating board flags in 1.769 seconds
2018-10-27 03:21:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 03:21:49 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 03:22:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 03:22:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:22:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:22:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:22:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:22:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:22:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:22:20 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-27 03:22:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 03:22:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 03:23:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 03:23:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:23:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:23:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:23:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:23:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:23:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:23:20 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-10-27 03:23:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 03:23:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 03:23:49 [DEBUG   ] Got command RPT from MCS: ref #283698
2018-10-27 03:23:49 [DEBUG   ] summary = ERROR
2018-10-27 03:23:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283698  13 58418 12229397 A  ERRORERROR'
2018-10-27 03:23:49 [DEBUG   ] Got command RPT from MCS: ref #283699
2018-10-27 03:23:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:23:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283699  77 58418 12229601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:23:49 [DEBUG   ] Got command RPT from MCS: ref #283700
2018-10-27 03:23:49 [DEBUG   ] summary = ERROR
2018-10-27 03:23:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283700  13 58418 12229805 A  ERRORERROR'
2018-10-27 03:23:49 [DEBUG   ] Got command RPT from MCS: ref #283702
2018-10-27 03:23:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:23:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283702  77 58418 12229997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:23:50 [DEBUG   ] Got command RPT from MCS: ref #283703
2018-10-27 03:23:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 03:23:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283703  12 58418 12230201 A  ERRORB—™š'
2018-10-27 03:24:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 03:24:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:24:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:24:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:24:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:24:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:24:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:24:20 [DEBUG   ] Finished updating board flags in 1.695 seconds
2018-10-27 03:24:29 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 03:24:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 03:25:09 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-27 03:25:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:25:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 03:25:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:25:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:25:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:25:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:25:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:25:20 [DEBUG   ] Finished updating board flags in 1.502 seconds
2018-10-27 03:25:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-27 03:25:37 [DEBUG   ] Got command RPT from MCS: ref #283708
2018-10-27 03:25:37 [DEBUG   ] summary = ERROR
2018-10-27 03:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283708  13 58418 12337597 A  ERRORERROR'
2018-10-27 03:25:37 [DEBUG   ] Got command RPT from MCS: ref #283709
2018-10-27 03:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283709  77 58418 12337598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:25:50 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-27 03:26:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 03:26:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-27 03:26:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:26:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:26:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:26:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:26:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:26:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:26:20 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-10-27 03:26:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 03:26:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 03:27:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 03:27:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:27:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:27:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:27:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:27:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:27:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:27:20 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-27 03:27:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 03:27:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 03:28:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 03:28:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:28:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 03:28:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:28:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:28:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:28:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:28:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:28:20 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-27 03:28:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 03:28:49 [DEBUG   ] Got command RPT from MCS: ref #283729
2018-10-27 03:28:49 [DEBUG   ] summary = ERROR
2018-10-27 03:28:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283729  13 58418 12529489 A  ERRORERROR'
2018-10-27 03:28:49 [DEBUG   ] Got command RPT from MCS: ref #283730
2018-10-27 03:28:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:28:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283730  77 58418 12529694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:28:49 [DEBUG   ] Got command RPT from MCS: ref #283731
2018-10-27 03:28:49 [DEBUG   ] summary = ERROR
2018-10-27 03:28:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283731  13 58418 12529889 A  ERRORERROR'
2018-10-27 03:28:50 [DEBUG   ] Got command RPT from MCS: ref #283732
2018-10-27 03:28:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:28:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283732  77 58418 12530093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:28:50 [DEBUG   ] Got command RPT from MCS: ref #283733
2018-10-27 03:28:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 03:28:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283733  12 58418 12530297 A  ERRORB˜™š'
2018-10-27 03:28:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 03:29:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 03:29:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:29:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:29:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:29:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:29:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:29:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:29:20 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-10-27 03:29:31 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-27 03:29:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 03:30:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 03:30:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:30:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 03:30:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:30:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:30:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:30:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:30:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:30:20 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-10-27 03:30:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 03:30:37 [DEBUG   ] Got command RPT from MCS: ref #283738
2018-10-27 03:30:37 [DEBUG   ] summary = ERROR
2018-10-27 03:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283738  13 58418 12637605 A  ERRORERROR'
2018-10-27 03:30:37 [DEBUG   ] Got command RPT from MCS: ref #283739
2018-10-27 03:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283739  77 58418 12637606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:30:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 03:31:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 03:31:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-27 03:31:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:31:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:31:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:31:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:31:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:31:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:31:20 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-10-27 03:31:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 03:31:51 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-10-27 03:32:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 03:32:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 03:32:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:32:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:32:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:32:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:32:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:32:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:32:20 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-27 03:32:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 03:32:51 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 03:33:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 03:33:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 03:33:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-27 03:33:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:33:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:33:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:33:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:33:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:33:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:33:20 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-27 03:33:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 03:33:49 [DEBUG   ] Got command RPT from MCS: ref #283761
2018-10-27 03:33:49 [DEBUG   ] summary = ERROR
2018-10-27 03:33:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283761  13 58418 12829585 A  ERRORERROR'
2018-10-27 03:33:49 [DEBUG   ] Got command RPT from MCS: ref #283762
2018-10-27 03:33:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:33:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283762  77 58418 12829777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:33:49 [DEBUG   ] Got command RPT from MCS: ref #283763
2018-10-27 03:33:49 [DEBUG   ] summary = ERROR
2018-10-27 03:33:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283763  13 58418 12829981 A  ERRORERROR'
2018-10-27 03:33:50 [DEBUG   ] Got command RPT from MCS: ref #283765
2018-10-27 03:33:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:33:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283765  77 58418 12830185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:33:50 [DEBUG   ] Got command RPT from MCS: ref #283767
2018-10-27 03:33:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 03:33:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283767  12 58418 12830389 A  ERRORB™™š'
2018-10-27 03:33:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 03:34:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 03:34:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:34:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:34:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:34:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:34:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:34:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:34:20 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-27 03:34:32 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-27 03:34:51 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-27 03:35:12 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 03:35:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 03:35:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:35:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 03:35:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:35:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:35:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:35:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:35:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:35:20 [DEBUG   ] Finished updating board flags in 1.447 seconds
2018-10-27 03:35:32 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-10-27 03:35:37 [DEBUG   ] Got command RPT from MCS: ref #283775
2018-10-27 03:35:37 [DEBUG   ] summary = ERROR
2018-10-27 03:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283775  13 58418 12937597 A  ERRORERROR'
2018-10-27 03:35:37 [DEBUG   ] Got command RPT from MCS: ref #283776
2018-10-27 03:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283776  77 58418 12937598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:35:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 03:36:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 03:36:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:36:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 03:36:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:36:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:36:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:36:20 [WARNING ] (13, 1, 'bot')
2018-10-27 03:36:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:36:20 [DEBUG   ] Finished updating board flags in 1.450 seconds
2018-10-27 03:36:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 03:36:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 03:37:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 03:37:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:37:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:37:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:37:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:37:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:37:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:37:21 [DEBUG   ] Finished updating board flags in 2.192 seconds
2018-10-27 03:37:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 03:37:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 03:38:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 03:38:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:38:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:38:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:38:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:38:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:38:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:38:21 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-10-27 03:38:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 03:38:49 [DEBUG   ] Got command RPT from MCS: ref #283796
2018-10-27 03:38:49 [DEBUG   ] summary = ERROR
2018-10-27 03:38:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283796  13 58418 13129673 A  ERRORERROR'
2018-10-27 03:38:49 [DEBUG   ] Got command RPT from MCS: ref #283797
2018-10-27 03:38:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:38:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283797  77 58418 13129865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:38:50 [DEBUG   ] Got command RPT from MCS: ref #283798
2018-10-27 03:38:50 [DEBUG   ] summary = ERROR
2018-10-27 03:38:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283798  13 58418 13130069 A  ERRORERROR'
2018-10-27 03:38:50 [DEBUG   ] Got command RPT from MCS: ref #283799
2018-10-27 03:38:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:38:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283799  77 58418 13130273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:38:50 [DEBUG   ] Got command RPT from MCS: ref #283800
2018-10-27 03:38:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 03:38:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283800  12 58418 13130477 A  ERRORB˜™š'
2018-10-27 03:38:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 03:39:12 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 03:39:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:39:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:39:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:39:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:39:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:39:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:39:21 [DEBUG   ] Finished updating board flags in 1.978 seconds
2018-10-27 03:39:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 03:39:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 03:40:13 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 03:40:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:40:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 03:40:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:40:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:40:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:40:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:40:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:40:21 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-27 03:40:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-27 03:40:37 [DEBUG   ] Got command RPT from MCS: ref #283801
2018-10-27 03:40:37 [DEBUG   ] summary = ERROR
2018-10-27 03:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283801  13 58418 13237605 A  ERRORERROR'
2018-10-27 03:40:37 [DEBUG   ] Got command RPT from MCS: ref #283802
2018-10-27 03:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283802  77 58418 13237606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:40:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 03:41:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 03:41:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:41:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 03:41:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:41:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:41:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:41:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:41:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:41:21 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-10-27 03:41:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 03:41:53 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 03:42:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 03:42:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:42:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:42:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:42:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:42:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:42:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:42:22 [DEBUG   ] Finished updating board flags in 2.613 seconds
2018-10-27 03:42:33 [DEBUG   ] Finished updating ant stats in 0.792 seconds
2018-10-27 03:42:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 03:43:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 03:43:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:43:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 03:43:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:43:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:43:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:43:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:43:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:43:21 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-10-27 03:43:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 03:43:49 [DEBUG   ] Got command RPT from MCS: ref #283824
2018-10-27 03:43:49 [DEBUG   ] summary = ERROR
2018-10-27 03:43:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283824  13 58418 13429757 A  ERRORERROR'
2018-10-27 03:43:49 [DEBUG   ] Got command RPT from MCS: ref #283825
2018-10-27 03:43:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:43:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283825  77 58418 13429961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:43:50 [DEBUG   ] Got command RPT from MCS: ref #283826
2018-10-27 03:43:50 [DEBUG   ] summary = ERROR
2018-10-27 03:43:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283826  13 58418 13430153 A  ERRORERROR'
2018-10-27 03:43:50 [DEBUG   ] Got command RPT from MCS: ref #283828
2018-10-27 03:43:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:43:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283828  77 58418 13430357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:43:50 [DEBUG   ] Got command RPT from MCS: ref #283829
2018-10-27 03:43:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 03:43:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283829  12 58418 13430561 A  ERRORB—™š'
2018-10-27 03:43:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 03:44:14 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-10-27 03:44:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:44:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:44:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:44:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:44:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:44:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:44:21 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-10-27 03:44:33 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-10-27 03:44:53 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-27 03:45:13 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-27 03:45:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:45:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:45:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:45:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:45:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:45:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:45:21 [DEBUG   ] Finished updating board flags in 1.477 seconds
2018-10-27 03:45:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-27 03:45:37 [DEBUG   ] Got command RPT from MCS: ref #283838
2018-10-27 03:45:37 [DEBUG   ] summary = ERROR
2018-10-27 03:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283838  13 58418 13537605 A  ERRORERROR'
2018-10-27 03:45:37 [DEBUG   ] Got command RPT from MCS: ref #283839
2018-10-27 03:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283839  77 58418 13537606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:45:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 03:46:14 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 03:46:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:46:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:46:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:46:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:46:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:46:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:46:21 [DEBUG   ] Finished updating board flags in 1.460 seconds
2018-10-27 03:46:34 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-10-27 03:46:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 03:47:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 03:47:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:47:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:47:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:47:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:47:21 [WARNING ] (13, 1, 'bot')
2018-10-27 03:47:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:47:21 [DEBUG   ] Finished updating board flags in 1.462 seconds
2018-10-27 03:47:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 03:47:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 03:48:00 [DEBUG   ] Got command TBN from MCS: ref #283859
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-27 03:48:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   283859   8 58418 13680846 A  ERROR'
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540612082']
2018-10-27 03:48:00 [DEBUG   ] spawn_process: at 2018-10-27 03:48:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540612082']
2018-10-27 03:48:00 [INFO    ] Finished spawning TBN in 0.054 s
2018-10-27 03:48:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 03:48:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:48:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:48:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:48:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:48:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:48:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:48:22 [DEBUG   ] Finished updating board flags in 2.293 seconds
2018-10-27 03:48:34 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-27 03:48:49 [DEBUG   ] Got command RPT from MCS: ref #283860
2018-10-27 03:48:49 [DEBUG   ] summary = ERROR
2018-10-27 03:48:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283860  13 58418 13729837 A  ERRORERROR'
2018-10-27 03:48:50 [DEBUG   ] Got command RPT from MCS: ref #283861
2018-10-27 03:48:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:48:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283861  77 58418 13730041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:48:50 [DEBUG   ] Got command RPT from MCS: ref #283862
2018-10-27 03:48:50 [DEBUG   ] summary = ERROR
2018-10-27 03:48:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283862  13 58418 13730245 A  ERRORERROR'
2018-10-27 03:48:50 [DEBUG   ] Got command RPT from MCS: ref #283863
2018-10-27 03:48:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:48:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283863  77 58418 13730449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:48:50 [DEBUG   ] Got command RPT from MCS: ref #283864
2018-10-27 03:48:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 03:48:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283864  12 58418 13730641 A  ERRORB˜™š'
2018-10-27 03:48:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 03:49:14 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-27 03:49:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:49:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:49:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:49:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:49:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:49:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:49:22 [DEBUG   ] Finished updating board flags in 2.187 seconds
2018-10-27 03:49:35 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-27 03:49:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 03:50:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 03:50:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:50:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:50:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:50:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:50:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:50:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:50:22 [DEBUG   ] Finished updating board flags in 1.917 seconds
2018-10-27 03:50:35 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-10-27 03:50:37 [DEBUG   ] Got command RPT from MCS: ref #283869
2018-10-27 03:50:37 [DEBUG   ] summary = ERROR
2018-10-27 03:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283869  13 58418 13837609 A  ERRORERROR'
2018-10-27 03:50:37 [DEBUG   ] Got command RPT from MCS: ref #283870
2018-10-27 03:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283870  77 58418 13837610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:50:55 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 03:51:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 03:51:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:51:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:51:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:51:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:51:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:51:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:51:22 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-27 03:51:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 03:51:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 03:52:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 03:52:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:52:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:52:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:52:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:52:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:52:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:52:22 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-10-27 03:52:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 03:52:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 03:53:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 03:53:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:53:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:53:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:53:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:53:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:53:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:53:22 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-27 03:53:35 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-10-27 03:53:49 [DEBUG   ] Got command RPT from MCS: ref #283892
2018-10-27 03:53:49 [DEBUG   ] summary = ERROR
2018-10-27 03:53:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283892  13 58418 14029925 A  ERRORERROR'
2018-10-27 03:53:50 [DEBUG   ] Got command RPT from MCS: ref #283893
2018-10-27 03:53:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:53:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283893  77 58418 14030129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:53:50 [DEBUG   ] Got command RPT from MCS: ref #283894
2018-10-27 03:53:50 [DEBUG   ] summary = ERROR
2018-10-27 03:53:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283894  13 58418 14030333 A  ERRORERROR'
2018-10-27 03:53:50 [DEBUG   ] Got command RPT from MCS: ref #283896
2018-10-27 03:53:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:53:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283896  77 58418 14030525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:53:50 [DEBUG   ] Got command RPT from MCS: ref #283898
2018-10-27 03:53:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 03:53:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283898  12 58418 14030729 A  ERRORB™™š'
2018-10-27 03:53:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 03:54:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 03:54:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:54:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 03:54:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:54:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:54:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:54:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:54:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:54:22 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-10-27 03:54:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 03:54:55 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-27 03:55:15 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-27 03:55:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:55:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 03:55:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:55:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:55:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:55:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:55:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:55:22 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-10-27 03:55:36 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 03:55:37 [DEBUG   ] Got command RPT from MCS: ref #283902
2018-10-27 03:55:37 [DEBUG   ] summary = ERROR
2018-10-27 03:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283902  13 58418 14137601 A  ERRORERROR'
2018-10-27 03:55:37 [DEBUG   ] Got command RPT from MCS: ref #283903
2018-10-27 03:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283903  77 58418 14137602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:55:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-27 03:56:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 03:56:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:56:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:56:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:56:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:56:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:56:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:56:22 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-27 03:56:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 03:56:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 03:57:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 03:57:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 03:57:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:57:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:57:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:57:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:57:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:57:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:57:22 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-10-27 03:57:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 03:57:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 03:58:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 03:58:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:58:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:58:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:58:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:58:22 [WARNING ] (13, 1, 'bot')
2018-10-27 03:58:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:58:22 [DEBUG   ] Finished updating board flags in 1.350 seconds
2018-10-27 03:58:36 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-10-27 03:58:50 [DEBUG   ] Got command RPT from MCS: ref #283923
2018-10-27 03:58:50 [DEBUG   ] summary = ERROR
2018-10-27 03:58:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283923  13 58418 14330082 A  ERRORERROR'
2018-10-27 03:58:50 [DEBUG   ] Got command RPT from MCS: ref #283924
2018-10-27 03:58:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:58:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283924  77 58418 14330213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:58:50 [DEBUG   ] Got command RPT from MCS: ref #283925
2018-10-27 03:58:50 [DEBUG   ] summary = ERROR
2018-10-27 03:58:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283925  13 58418 14330417 A  ERRORERROR'
2018-10-27 03:58:50 [DEBUG   ] Got command RPT from MCS: ref #283926
2018-10-27 03:58:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 03:58:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283926  77 58418 14330609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 03:58:50 [DEBUG   ] Got command RPT from MCS: ref #283927
2018-10-27 03:58:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 03:58:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283927  12 58418 14330813 A  ERRORB™™š'
2018-10-27 03:58:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 03:59:16 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-27 03:59:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 03:59:23 [WARNING ] (13, 1, 'bot')
2018-10-27 03:59:23 [WARNING ] (13, 1, 'bot')
2018-10-27 03:59:23 [WARNING ] (13, 1, 'bot')
2018-10-27 03:59:23 [WARNING ] (13, 1, 'bot')
2018-10-27 03:59:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 03:59:23 [DEBUG   ] Finished updating board flags in 2.062 seconds
2018-10-27 03:59:37 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-27 03:59:57 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 04:00:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 04:00:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:00:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:00:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:00:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:00:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:00:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:00:23 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-10-27 04:00:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 04:00:37 [DEBUG   ] Got command RPT from MCS: ref #283932
2018-10-27 04:00:37 [DEBUG   ] summary = ERROR
2018-10-27 04:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283932  13 58418 14437605 A  ERRORERROR'
2018-10-27 04:00:37 [DEBUG   ] Got command RPT from MCS: ref #283933
2018-10-27 04:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283933  77 58418 14437606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:00:57 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-27 04:01:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 04:01:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:01:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 04:01:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:01:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:01:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:01:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:01:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:01:23 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-10-27 04:01:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 04:01:57 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 04:02:17 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-10-27 04:02:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:02:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:02:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:02:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:02:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:02:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:02:23 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-27 04:02:38 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-27 04:02:58 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 04:03:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 04:03:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:03:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 04:03:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:03:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:03:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:03:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:03:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:03:23 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-27 04:03:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 04:03:50 [DEBUG   ] Got command RPT from MCS: ref #283955
2018-10-27 04:03:50 [DEBUG   ] summary = ERROR
2018-10-27 04:03:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283955  13 58418 14630093 A  ERRORERROR'
2018-10-27 04:03:50 [DEBUG   ] Got command RPT from MCS: ref #283956
2018-10-27 04:03:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:03:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283956  77 58418 14630297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:03:50 [DEBUG   ] Got command RPT from MCS: ref #283957
2018-10-27 04:03:50 [DEBUG   ] summary = ERROR
2018-10-27 04:03:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283957  13 58418 14630501 A  ERRORERROR'
2018-10-27 04:03:50 [DEBUG   ] Got command RPT from MCS: ref #283959
2018-10-27 04:03:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:03:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283959  77 58418 14630693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:03:50 [DEBUG   ] Got command RPT from MCS: ref #283960
2018-10-27 04:03:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 04:03:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283960  12 58418 14630897 A  ERRORB˜™š'
2018-10-27 04:03:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 04:04:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 04:04:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:04:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 04:04:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:04:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:04:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:04:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:04:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:04:23 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-27 04:04:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 04:04:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 04:05:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 04:05:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:05:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:05:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:05:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:05:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:05:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:05:23 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-10-27 04:05:37 [DEBUG   ] Got command RPT from MCS: ref #283969
2018-10-27 04:05:37 [DEBUG   ] summary = ERROR
2018-10-27 04:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283969  13 58418 14737609 A  ERRORERROR'
2018-10-27 04:05:37 [DEBUG   ] Got command RPT from MCS: ref #283970
2018-10-27 04:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283970  77 58418 14737610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:05:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 04:05:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 04:06:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 04:06:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:06:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:06:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:06:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:06:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:06:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:06:23 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-10-27 04:06:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 04:06:58 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-27 04:07:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 04:07:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:07:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:07:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:07:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:07:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:07:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:07:23 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-27 04:07:39 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-27 04:07:59 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-27 04:08:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 04:08:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:08:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-10-27 04:08:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:08:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:08:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:08:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:08:23 [WARNING ] (25, 5, 'bot')
2018-10-27 04:08:23 [WARNING ] (25, 5, 'bot')
2018-10-27 04:08:23 [WARNING ] (25, 5, 'bot')
2018-10-27 04:08:23 [WARNING ] (25, 5, 'bot')
2018-10-27 04:08:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:08:23 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-10-27 04:08:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 04:08:50 [DEBUG   ] Got command RPT from MCS: ref #283990
2018-10-27 04:08:50 [DEBUG   ] summary = ERROR
2018-10-27 04:08:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283990  13 58418 14930185 A  ERRORERROR'
2018-10-27 04:08:50 [DEBUG   ] Got command RPT from MCS: ref #283991
2018-10-27 04:08:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:08:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283991  77 58418 14930389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:08:50 [DEBUG   ] Got command RPT from MCS: ref #283992
2018-10-27 04:08:50 [DEBUG   ] summary = ERROR
2018-10-27 04:08:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283992  13 58418 14930581 A  ERRORERROR'
2018-10-27 04:08:50 [DEBUG   ] Got command RPT from MCS: ref #283993
2018-10-27 04:08:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:08:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283993  77 58418 14930785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:08:50 [DEBUG   ] Got command RPT from MCS: ref #283994
2018-10-27 04:08:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 04:08:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283994  12 58418 14930989 A  ERRORB—™š'
2018-10-27 04:08:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 04:09:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 04:09:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 04:09:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:09:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:09:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:09:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:09:23 [WARNING ] (13, 1, 'bot')
2018-10-27 04:09:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:09:23 [DEBUG   ] Finished updating board flags in 1.348 seconds
2018-10-27 04:09:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 04:09:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 04:10:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 04:10:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:10:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 04:10:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:10:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:10:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:10:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:10:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:10:24 [DEBUG   ] Finished updating board flags in 2.062 seconds
2018-10-27 04:10:37 [DEBUG   ] Got command RPT from MCS: ref #283995
2018-10-27 04:10:37 [DEBUG   ] summary = ERROR
2018-10-27 04:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283995  13 58418 15037609 A  ERRORERROR'
2018-10-27 04:10:37 [DEBUG   ] Got command RPT from MCS: ref #283996
2018-10-27 04:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   283996  77 58418 15037610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:10:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 04:10:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 04:11:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 04:11:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:11:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:11:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:11:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:11:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:11:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:11:24 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-10-27 04:11:40 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-10-27 04:11:59 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-10-27 04:12:20 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 04:12:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:12:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:12:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:12:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:12:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:12:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:12:24 [DEBUG   ] Finished updating board flags in 1.999 seconds
2018-10-27 04:12:40 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 04:13:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 04:13:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 04:13:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:13:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 04:13:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:13:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:13:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:13:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:13:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:13:24 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-10-27 04:13:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 04:13:50 [DEBUG   ] Got command RPT from MCS: ref #284018
2018-10-27 04:13:50 [DEBUG   ] summary = ERROR
2018-10-27 04:13:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284018  13 58418 15230273 A  ERRORERROR'
2018-10-27 04:13:50 [DEBUG   ] Got command RPT from MCS: ref #284019
2018-10-27 04:13:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:13:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284019  77 58418 15230465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:13:50 [DEBUG   ] Got command RPT from MCS: ref #284020
2018-10-27 04:13:50 [DEBUG   ] summary = ERROR
2018-10-27 04:13:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284020  13 58418 15230669 A  ERRORERROR'
2018-10-27 04:13:50 [DEBUG   ] Got command RPT from MCS: ref #284022
2018-10-27 04:13:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:13:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284022  77 58418 15230873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:13:51 [DEBUG   ] Got command RPT from MCS: ref #284023
2018-10-27 04:13:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 04:13:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284023  12 58418 15231077 A  ERRORB™™š'
2018-10-27 04:14:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 04:14:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 04:14:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:14:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-27 04:14:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:14:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:14:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:14:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:14:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:14:24 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-10-27 04:14:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 04:15:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 04:15:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 04:15:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-27 04:15:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:15:24 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 04:15:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:15:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:15:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:15:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:15:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:15:24 [DEBUG   ] Finished updating board flags in 1.800 seconds
2018-10-27 04:15:37 [DEBUG   ] Got command RPT from MCS: ref #284032
2018-10-27 04:15:37 [DEBUG   ] summary = ERROR
2018-10-27 04:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284032  13 58418 15337605 A  ERRORERROR'
2018-10-27 04:15:37 [DEBUG   ] Got command RPT from MCS: ref #284033
2018-10-27 04:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284033  77 58418 15337606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:15:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 04:16:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 04:16:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 04:16:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:16:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:16:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:16:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:16:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:16:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:16:24 [DEBUG   ] Finished updating board flags in 1.828 seconds
2018-10-27 04:16:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 04:17:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 04:17:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 04:17:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:17:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:17:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:17:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:17:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:17:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:17:24 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-10-27 04:17:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 04:18:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 04:18:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 04:18:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:18:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-27 04:18:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:18:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:18:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:18:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:18:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:18:24 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-10-27 04:18:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 04:18:50 [DEBUG   ] Got command RPT from MCS: ref #284053
2018-10-27 04:18:50 [DEBUG   ] summary = ERROR
2018-10-27 04:18:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284053  13 58418 15530357 A  ERRORERROR'
2018-10-27 04:18:50 [DEBUG   ] Got command RPT from MCS: ref #284054
2018-10-27 04:18:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:18:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284054  77 58418 15530561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:18:50 [DEBUG   ] Got command RPT from MCS: ref #284055
2018-10-27 04:18:50 [DEBUG   ] summary = ERROR
2018-10-27 04:18:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284055  13 58418 15530753 A  ERRORERROR'
2018-10-27 04:18:50 [DEBUG   ] Got command RPT from MCS: ref #284056
2018-10-27 04:18:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:18:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284056  77 58418 15530957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:18:51 [DEBUG   ] Got command RPT from MCS: ref #284057
2018-10-27 04:18:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 04:18:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284057  12 58418 15531165 A  ERRORB™™š'
2018-10-27 04:19:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 04:19:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 04:19:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:19:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:19:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:19:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:19:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:19:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:19:24 [DEBUG   ] Finished updating board flags in 1.569 seconds
2018-10-27 04:19:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 04:20:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 04:20:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 04:20:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:20:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:20:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:20:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:20:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:20:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:20:24 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-10-27 04:20:37 [DEBUG   ] Got command RPT from MCS: ref #284062
2018-10-27 04:20:37 [DEBUG   ] summary = ERROR
2018-10-27 04:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284062  13 58418 15637609 A  ERRORERROR'
2018-10-27 04:20:37 [DEBUG   ] Got command RPT from MCS: ref #284063
2018-10-27 04:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284063  77 58418 15637610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:20:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 04:21:00 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-10-27 04:21:21 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-27 04:21:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:21:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:21:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:21:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:21:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:21:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:21:24 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-10-27 04:21:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 04:22:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 04:22:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 04:22:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:22:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:22:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:22:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:22:24 [WARNING ] (13, 1, 'bot')
2018-10-27 04:22:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:22:24 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-10-27 04:22:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 04:23:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 04:23:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 04:23:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:23:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:23:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:23:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:23:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:23:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:23:25 [DEBUG   ] Finished updating board flags in 2.315 seconds
2018-10-27 04:23:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 04:23:50 [DEBUG   ] Got command RPT from MCS: ref #284085
2018-10-27 04:23:50 [DEBUG   ] summary = ERROR
2018-10-27 04:23:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284085  13 58418 15830445 A  ERRORERROR'
2018-10-27 04:23:50 [DEBUG   ] Got command RPT from MCS: ref #284086
2018-10-27 04:23:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:23:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284086  77 58418 15830649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:23:50 [DEBUG   ] Got command RPT from MCS: ref #284087
2018-10-27 04:23:50 [DEBUG   ] summary = ERROR
2018-10-27 04:23:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284087  13 58418 15830856 A  ERRORERROR'
2018-10-27 04:23:51 [DEBUG   ] Got command RPT from MCS: ref #284089
2018-10-27 04:23:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:23:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284089  77 58418 15831045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:23:51 [DEBUG   ] Got command RPT from MCS: ref #284090
2018-10-27 04:23:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 04:23:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284090  12 58418 15831249 A  ERRORB˜™š'
2018-10-27 04:24:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 04:24:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 04:24:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:24:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:24:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:24:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:24:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:24:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:24:25 [DEBUG   ] Finished updating board flags in 2.068 seconds
2018-10-27 04:24:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 04:25:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 04:25:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 04:25:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:25:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:25:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:25:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:25:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:25:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:25:25 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-10-27 04:25:37 [DEBUG   ] Got command RPT from MCS: ref #284095
2018-10-27 04:25:37 [DEBUG   ] summary = ERROR
2018-10-27 04:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284095  13 58418 15937609 A  ERRORERROR'
2018-10-27 04:25:37 [DEBUG   ] Got command RPT from MCS: ref #284096
2018-10-27 04:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284096  77 58418 15937610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:25:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 04:26:01 [DEBUG   ] Finished updating ant stats in 0.607 seconds
2018-10-27 04:26:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 04:26:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:26:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:26:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:26:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:26:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:26:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:26:25 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-10-27 04:26:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 04:27:02 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-27 04:27:21 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-10-27 04:27:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:27:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 04:27:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:27:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:27:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:27:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:27:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:27:25 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-27 04:27:42 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-27 04:28:02 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 04:28:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 04:28:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:28:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:28:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:28:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:28:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:28:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:28:25 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-10-27 04:28:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 04:28:50 [DEBUG   ] Got command RPT from MCS: ref #284116
2018-10-27 04:28:50 [DEBUG   ] summary = ERROR
2018-10-27 04:28:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284116  13 58418 16130533 A  ERRORERROR'
2018-10-27 04:28:50 [DEBUG   ] Got command RPT from MCS: ref #284117
2018-10-27 04:28:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:28:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284117  77 58418 16130725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:28:50 [DEBUG   ] Got command RPT from MCS: ref #284118
2018-10-27 04:28:50 [DEBUG   ] summary = ERROR
2018-10-27 04:28:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284118  13 58418 16130929 A  ERRORERROR'
2018-10-27 04:28:51 [DEBUG   ] Got command RPT from MCS: ref #284119
2018-10-27 04:28:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:28:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284119  77 58418 16131133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:28:51 [DEBUG   ] Got command RPT from MCS: ref #284120
2018-10-27 04:28:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 04:28:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284120  12 58418 16131325 A  ERRORB—™š'
2018-10-27 04:29:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 04:29:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 04:29:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:29:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:29:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:29:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:29:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:29:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:29:25 [DEBUG   ] Finished updating board flags in 1.954 seconds
2018-10-27 04:29:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 04:30:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 04:30:22 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 04:30:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 04:30:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:30:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:30:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:30:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:30:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:30:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:30:25 [DEBUG   ] Finished updating board flags in 1.446 seconds
2018-10-27 04:30:37 [DEBUG   ] Got command RPT from MCS: ref #284125
2018-10-27 04:30:37 [DEBUG   ] summary = ERROR
2018-10-27 04:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284125  13 58418 16237613 A  ERRORERROR'
2018-10-27 04:30:37 [DEBUG   ] Got command RPT from MCS: ref #284126
2018-10-27 04:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284126  77 58418 16237614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:30:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 04:31:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 04:31:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 04:31:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:31:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:31:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:31:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:31:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:31:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:31:25 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-10-27 04:31:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 04:32:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 04:32:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 04:32:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:32:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:32:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:32:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:32:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:32:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:32:25 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-10-27 04:32:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 04:33:02 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 04:33:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 04:33:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:33:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:33:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:33:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:33:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:33:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:33:25 [DEBUG   ] Finished updating board flags in 1.601 seconds
2018-10-27 04:33:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 04:33:50 [DEBUG   ] Got command RPT from MCS: ref #284148
2018-10-27 04:33:50 [DEBUG   ] summary = ERROR
2018-10-27 04:33:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284148  13 58418 16430617 A  ERRORERROR'
2018-10-27 04:33:50 [DEBUG   ] Got command RPT from MCS: ref #284149
2018-10-27 04:33:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:33:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284149  77 58418 16430809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:33:51 [DEBUG   ] Got command RPT from MCS: ref #284150
2018-10-27 04:33:51 [DEBUG   ] summary = ERROR
2018-10-27 04:33:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284150  13 58418 16431013 A  ERRORERROR'
2018-10-27 04:33:51 [DEBUG   ] Got command RPT from MCS: ref #284152
2018-10-27 04:33:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:33:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284152  77 58418 16431217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:33:51 [DEBUG   ] Got command RPT from MCS: ref #284153
2018-10-27 04:33:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 04:33:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284153  12 58418 16431421 A  ERRORB—™š'
2018-10-27 04:34:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 04:34:23 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-10-27 04:34:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:34:25 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 04:34:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:34:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:34:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:34:25 [WARNING ] (13, 1, 'bot')
2018-10-27 04:34:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:34:25 [DEBUG   ] Finished updating board flags in 1.360 seconds
2018-10-27 04:34:42 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-10-27 04:35:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 04:35:23 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-27 04:35:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:35:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:35:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:35:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:35:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:35:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:35:26 [DEBUG   ] Finished updating board flags in 2.225 seconds
2018-10-27 04:35:37 [DEBUG   ] Got command RPT from MCS: ref #284162
2018-10-27 04:35:37 [DEBUG   ] summary = ERROR
2018-10-27 04:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284162  13 58418 16537617 A  ERRORERROR'
2018-10-27 04:35:37 [DEBUG   ] Got command RPT from MCS: ref #284163
2018-10-27 04:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284163  77 58418 16537618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:35:43 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-27 04:36:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 04:36:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 04:36:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:36:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:36:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:36:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:36:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:36:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:36:26 [DEBUG   ] Finished updating board flags in 2.169 seconds
2018-10-27 04:36:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 04:37:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 04:37:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 04:37:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:37:26 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 04:37:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:37:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:37:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:37:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:37:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:37:26 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-10-27 04:37:43 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-10-27 04:38:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 04:38:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 04:38:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:38:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:38:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:38:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:38:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:38:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:38:26 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-27 04:38:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 04:38:50 [DEBUG   ] Got command RPT from MCS: ref #284183
2018-10-27 04:38:50 [DEBUG   ] summary = ERROR
2018-10-27 04:38:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284183  13 58418 16730705 A  ERRORERROR'
2018-10-27 04:38:50 [DEBUG   ] Got command RPT from MCS: ref #284184
2018-10-27 04:38:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:38:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284184  77 58418 16730897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:38:51 [DEBUG   ] Got command RPT from MCS: ref #284185
2018-10-27 04:38:51 [DEBUG   ] summary = ERROR
2018-10-27 04:38:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284185  13 58418 16731101 A  ERRORERROR'
2018-10-27 04:38:51 [DEBUG   ] Got command RPT from MCS: ref #284186
2018-10-27 04:38:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:38:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284186  77 58418 16731305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:38:51 [DEBUG   ] Got command RPT from MCS: ref #284187
2018-10-27 04:38:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 04:38:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284187  12 58418 16731497 A  ERRORB˜™š'
2018-10-27 04:39:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 04:39:24 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-27 04:39:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:39:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:39:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:39:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:39:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:39:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:39:26 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-10-27 04:39:44 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-27 04:40:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 04:40:24 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-27 04:40:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 04:40:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:40:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:40:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:40:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:40:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:40:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:40:26 [DEBUG   ] Finished updating board flags in 1.643 seconds
2018-10-27 04:40:37 [DEBUG   ] Got command RPT from MCS: ref #284188
2018-10-27 04:40:37 [DEBUG   ] summary = ERROR
2018-10-27 04:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284188  13 58418 16837621 A  ERRORERROR'
2018-10-27 04:40:37 [DEBUG   ] Got command RPT from MCS: ref #284189
2018-10-27 04:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284189  77 58418 16837622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:40:44 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-10-27 04:41:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 04:41:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 04:41:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:41:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:41:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:41:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:41:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:41:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:41:26 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-10-27 04:41:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 04:42:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 04:42:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 04:42:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 04:42:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:42:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:42:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:42:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:42:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:42:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:42:26 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-10-27 04:42:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 04:43:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 04:43:24 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 04:43:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:43:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:43:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:43:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:43:26 [WARNING ] (13, 1, 'bot')
2018-10-27 04:43:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:43:26 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-10-27 04:43:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 04:43:50 [DEBUG   ] Got command RPT from MCS: ref #284211
2018-10-27 04:43:50 [DEBUG   ] summary = ERROR
2018-10-27 04:43:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284211  13 58418 17030777 A  ERRORERROR'
2018-10-27 04:43:50 [DEBUG   ] Got command RPT from MCS: ref #284212
2018-10-27 04:43:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:43:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284212  77 58418 17030981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:43:51 [DEBUG   ] Got command RPT from MCS: ref #284213
2018-10-27 04:43:51 [DEBUG   ] summary = ERROR
2018-10-27 04:43:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284213  13 58418 17031185 A  ERRORERROR'
2018-10-27 04:43:51 [DEBUG   ] Got command RPT from MCS: ref #284215
2018-10-27 04:43:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:43:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284215  77 58418 17031389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:43:51 [DEBUG   ] Got command RPT from MCS: ref #284216
2018-10-27 04:43:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 04:43:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284216  12 58418 17031581 A  ERRORB—™š'
2018-10-27 04:44:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 04:44:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 04:44:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-10-27 04:44:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:44:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:44:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:44:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:44:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:44:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:44:27 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-10-27 04:44:44 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-10-27 04:45:05 [DEBUG   ] Finished updating ant stats in 1.387 seconds
2018-10-27 04:45:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 04:45:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 04:45:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:45:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:45:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:45:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:45:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:45:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:45:27 [DEBUG   ] Finished updating board flags in 1.999 seconds
2018-10-27 04:45:37 [DEBUG   ] Got command RPT from MCS: ref #284225
2018-10-27 04:45:37 [DEBUG   ] summary = ERROR
2018-10-27 04:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284225  13 58418 17137621 A  ERRORERROR'
2018-10-27 04:45:37 [DEBUG   ] Got command RPT from MCS: ref #284226
2018-10-27 04:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284226  77 58418 17137622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:45:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 04:46:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 04:46:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 04:46:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:46:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:46:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:46:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:46:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:46:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:46:27 [DEBUG   ] Finished updating board flags in 1.844 seconds
2018-10-27 04:46:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 04:47:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 04:47:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 04:47:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:47:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:47:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:47:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:47:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:47:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:47:27 [DEBUG   ] Finished updating board flags in 1.750 seconds
2018-10-27 04:47:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 04:48:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 04:48:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 04:48:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 04:48:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:48:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:48:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:48:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:48:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:48:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:48:27 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-27 04:48:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 04:48:50 [DEBUG   ] Got command RPT from MCS: ref #284246
2018-10-27 04:48:50 [DEBUG   ] summary = ERROR
2018-10-27 04:48:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284246  13 58418 17330873 A  ERRORERROR'
2018-10-27 04:48:51 [DEBUG   ] Got command RPT from MCS: ref #284247
2018-10-27 04:48:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:48:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284247  77 58418 17331065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:48:51 [DEBUG   ] Got command RPT from MCS: ref #284248
2018-10-27 04:48:51 [DEBUG   ] summary = ERROR
2018-10-27 04:48:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284248  13 58418 17331269 A  ERRORERROR'
2018-10-27 04:48:51 [DEBUG   ] Got command RPT from MCS: ref #284249
2018-10-27 04:48:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:48:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284249  77 58418 17331473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:48:51 [DEBUG   ] Got command RPT from MCS: ref #284250
2018-10-27 04:48:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 04:48:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284250  12 58418 17331665 A  ERRORB˜™š'
2018-10-27 04:49:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 04:49:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 04:49:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:49:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:49:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:49:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:49:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:49:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:49:27 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-10-27 04:49:46 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-27 04:50:06 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 04:50:26 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2018-10-27 04:50:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:50:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:50:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:50:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:50:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:50:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:50:27 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-27 04:50:37 [DEBUG   ] Got command RPT from MCS: ref #284255
2018-10-27 04:50:37 [DEBUG   ] summary = ERROR
2018-10-27 04:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284255  13 58418 17437621 A  ERRORERROR'
2018-10-27 04:50:37 [DEBUG   ] Got command RPT from MCS: ref #284256
2018-10-27 04:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284256  77 58418 17437622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:50:46 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2018-10-27 04:51:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 04:51:26 [DEBUG   ] Finished updating ant stats in 1.050 seconds
2018-10-27 04:51:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:51:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 04:51:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:51:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:51:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:51:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:51:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:51:27 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-27 04:51:46 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2018-10-27 04:52:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 04:52:26 [DEBUG   ] Finished updating ant stats in 0.841 seconds
2018-10-27 04:52:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:52:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:52:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:52:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:52:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:52:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:52:27 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-10-27 04:52:46 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2018-10-27 04:53:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 04:53:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 04:53:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:53:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:53:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:53:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:53:27 [WARNING ] (13, 1, 'bot')
2018-10-27 04:53:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:53:27 [DEBUG   ] Finished updating board flags in 1.351 seconds
2018-10-27 04:53:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 04:53:50 [DEBUG   ] Got command RPT from MCS: ref #284278
2018-10-27 04:53:50 [DEBUG   ] summary = ERROR
2018-10-27 04:53:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284278  13 58418 17630953 A  ERRORERROR'
2018-10-27 04:53:51 [DEBUG   ] Got command RPT from MCS: ref #284279
2018-10-27 04:53:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:53:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284279  77 58418 17631157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:53:51 [DEBUG   ] Got command RPT from MCS: ref #284280
2018-10-27 04:53:51 [DEBUG   ] summary = ERROR
2018-10-27 04:53:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284280  13 58418 17631349 A  ERRORERROR'
2018-10-27 04:53:51 [DEBUG   ] Got command RPT from MCS: ref #284282
2018-10-27 04:53:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:53:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284282  77 58418 17631553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:53:51 [DEBUG   ] Got command RPT from MCS: ref #284284
2018-10-27 04:53:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 04:53:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284284  12 58418 17631757 A  ERRORB—™š'
2018-10-27 04:54:06 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 04:54:27 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 04:54:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:54:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 04:54:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:54:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:54:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:54:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:54:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:54:28 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-10-27 04:54:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 04:55:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 04:55:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 04:55:27 [DEBUG   ] Finished updating ant stats in 1.248 seconds
2018-10-27 04:55:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:55:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 04:55:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:55:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:55:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:55:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:55:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:55:28 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-10-27 04:55:37 [DEBUG   ] Got command RPT from MCS: ref #284288
2018-10-27 04:55:37 [DEBUG   ] summary = ERROR
2018-10-27 04:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284288  13 58418 17737617 A  ERRORERROR'
2018-10-27 04:55:37 [DEBUG   ] Got command RPT from MCS: ref #284289
2018-10-27 04:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284289  77 58418 17737618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:55:47 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2018-10-27 04:56:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 04:56:27 [DEBUG   ] Finished updating ant stats in 1.049 seconds
2018-10-27 04:56:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:56:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:56:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:56:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:56:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:56:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:56:28 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-10-27 04:56:47 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2018-10-27 04:57:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 04:57:27 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2018-10-27 04:57:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:57:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:57:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:57:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:57:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:57:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:57:28 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-10-27 04:57:47 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2018-10-27 04:58:07 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-27 04:58:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:58:28 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 04:58:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:58:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:58:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:58:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:58:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:58:28 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-10-27 04:58:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 04:58:51 [DEBUG   ] Got command RPT from MCS: ref #284309
2018-10-27 04:58:51 [DEBUG   ] summary = ERROR
2018-10-27 04:58:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284309  13 58418 17931045 A  ERRORERROR'
2018-10-27 04:58:51 [DEBUG   ] Got command RPT from MCS: ref #284310
2018-10-27 04:58:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:58:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284310  77 58418 17931237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:58:51 [DEBUG   ] Got command RPT from MCS: ref #284311
2018-10-27 04:58:51 [DEBUG   ] summary = ERROR
2018-10-27 04:58:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284311  13 58418 17931441 A  ERRORERROR'
2018-10-27 04:58:51 [DEBUG   ] Got command RPT from MCS: ref #284312
2018-10-27 04:58:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 04:58:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284312  77 58418 17931645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 04:58:51 [DEBUG   ] Got command RPT from MCS: ref #284313
2018-10-27 04:58:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 04:58:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284313  12 58418 17931849 A  ERRORB–™š'
2018-10-27 04:59:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 04:59:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 04:59:28 [DEBUG   ] Finished updating ant stats in 1.243 seconds
2018-10-27 04:59:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 04:59:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:59:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:59:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:59:28 [WARNING ] (13, 1, 'bot')
2018-10-27 04:59:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 04:59:28 [DEBUG   ] Finished updating board flags in 1.655 seconds
2018-10-27 04:59:48 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2018-10-27 05:00:08 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 05:00:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:00:28 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2018-10-27 05:00:28 [WARNING ] (13, 1, 'bot')
2018-10-27 05:00:28 [WARNING ] (13, 1, 'bot')
2018-10-27 05:00:28 [WARNING ] (13, 1, 'bot')
2018-10-27 05:00:28 [WARNING ] (13, 1, 'bot')
2018-10-27 05:00:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:00:28 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-10-27 05:00:37 [DEBUG   ] Got command RPT from MCS: ref #284318
2018-10-27 05:00:37 [DEBUG   ] summary = ERROR
2018-10-27 05:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284318  13 58418 18037625 A  ERRORERROR'
2018-10-27 05:00:37 [DEBUG   ] Got command RPT from MCS: ref #284319
2018-10-27 05:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284319  77 58418 18037626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:00:48 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2018-10-27 05:01:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 05:01:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:01:28 [DEBUG   ] Finished updating ant stats in 0.650 seconds
2018-10-27 05:01:28 [WARNING ] (13, 1, 'bot')
2018-10-27 05:01:28 [WARNING ] (13, 1, 'bot')
2018-10-27 05:01:28 [WARNING ] (13, 1, 'bot')
2018-10-27 05:01:28 [WARNING ] (13, 1, 'bot')
2018-10-27 05:01:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:01:28 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-10-27 05:01:48 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2018-10-27 05:02:08 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-27 05:02:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:02:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 05:02:28 [WARNING ] (13, 1, 'bot')
2018-10-27 05:02:28 [WARNING ] (13, 1, 'bot')
2018-10-27 05:02:28 [WARNING ] (13, 1, 'bot')
2018-10-27 05:02:28 [WARNING ] (13, 1, 'bot')
2018-10-27 05:02:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:02:28 [DEBUG   ] Finished updating board flags in 1.478 seconds
2018-10-27 05:02:29 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-27 05:02:49 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-10-27 05:03:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 05:03:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:03:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 05:03:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:03:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:03:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:03:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:03:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:03:29 [DEBUG   ] Finished updating board flags in 2.530 seconds
2018-10-27 05:03:49 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-10-27 05:03:51 [DEBUG   ] Got command RPT from MCS: ref #284341
2018-10-27 05:03:51 [DEBUG   ] summary = ERROR
2018-10-27 05:03:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284341  13 58418 18231122 A  ERRORERROR'
2018-10-27 05:03:51 [DEBUG   ] Got command RPT from MCS: ref #284342
2018-10-27 05:03:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:03:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284342  77 58418 18231325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:03:51 [DEBUG   ] Got command RPT from MCS: ref #284343
2018-10-27 05:03:51 [DEBUG   ] summary = ERROR
2018-10-27 05:03:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284343  13 58418 18231529 A  ERRORERROR'
2018-10-27 05:03:51 [DEBUG   ] Got command RPT from MCS: ref #284345
2018-10-27 05:03:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:03:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284345  77 58418 18231733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:03:51 [DEBUG   ] Got command RPT from MCS: ref #284347
2018-10-27 05:03:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 05:03:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284347  12 58418 18231925 A  ERRORB—™š'
2018-10-27 05:04:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 05:04:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:04:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 05:04:29 [DEBUG   ] Finished updating ant stats in 1.043 seconds
2018-10-27 05:04:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:04:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:04:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:04:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:04:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:04:29 [DEBUG   ] Finished updating board flags in 2.213 seconds
2018-10-27 05:04:49 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2018-10-27 05:05:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 05:05:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:05:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 05:05:29 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2018-10-27 05:05:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:05:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:05:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:05:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:05:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:05:29 [DEBUG   ] Finished updating board flags in 2.198 seconds
2018-10-27 05:05:37 [DEBUG   ] Got command RPT from MCS: ref #284355
2018-10-27 05:05:37 [DEBUG   ] summary = ERROR
2018-10-27 05:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284355  13 58418 18337625 A  ERRORERROR'
2018-10-27 05:05:37 [DEBUG   ] Got command RPT from MCS: ref #284356
2018-10-27 05:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284356  77 58418 18337626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:05:49 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-10-27 05:06:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 05:06:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:06:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:06:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:06:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:06:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:06:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:06:29 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-10-27 05:06:30 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-10-27 05:06:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-27 05:07:10 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-27 05:07:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:07:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 05:07:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:07:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:07:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:07:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:07:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:07:29 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-10-27 05:07:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 05:07:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 05:08:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 05:08:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:08:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:08:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:08:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:08:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:08:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:08:29 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-10-27 05:08:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 05:08:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 05:08:51 [DEBUG   ] Got command RPT from MCS: ref #284376
2018-10-27 05:08:51 [DEBUG   ] summary = ERROR
2018-10-27 05:08:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284376  13 58418 18531213 A  ERRORERROR'
2018-10-27 05:08:51 [DEBUG   ] Got command RPT from MCS: ref #284377
2018-10-27 05:08:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:08:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284377  77 58418 18531417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:08:51 [DEBUG   ] Got command RPT from MCS: ref #284378
2018-10-27 05:08:51 [DEBUG   ] summary = ERROR
2018-10-27 05:08:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284378  13 58418 18531609 A  ERRORERROR'
2018-10-27 05:08:51 [DEBUG   ] Got command RPT from MCS: ref #284379
2018-10-27 05:08:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:08:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284379  77 58418 18531813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:08:52 [DEBUG   ] Got command RPT from MCS: ref #284380
2018-10-27 05:08:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 05:08:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284380  12 58418 18532017 A  ERRORB—™š'
2018-10-27 05:09:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 05:09:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:09:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:09:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:09:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:09:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:09:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:09:29 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-10-27 05:09:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 05:09:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 05:10:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 05:10:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:10:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:10:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:10:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:10:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:10:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:10:29 [DEBUG   ] Finished updating board flags in 1.561 seconds
2018-10-27 05:10:30 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-27 05:10:37 [DEBUG   ] Got command RPT from MCS: ref #284381
2018-10-27 05:10:37 [DEBUG   ] summary = ERROR
2018-10-27 05:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284381  13 58418 18637629 A  ERRORERROR'
2018-10-27 05:10:37 [DEBUG   ] Got command RPT from MCS: ref #284382
2018-10-27 05:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284382  77 58418 18637630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:10:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 05:11:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 05:11:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:11:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:11:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:11:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:11:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:11:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:11:29 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-10-27 05:11:30 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-27 05:11:51 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 05:12:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 05:12:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:12:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:12:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:12:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:12:29 [WARNING ] (13, 1, 'bot')
2018-10-27 05:12:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:12:29 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-10-27 05:12:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 05:12:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 05:13:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 05:13:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:13:31 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 05:13:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:13:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:13:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:13:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:13:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:13:31 [DEBUG   ] Finished updating board flags in 3.008 seconds
2018-10-27 05:13:51 [DEBUG   ] Got command RPT from MCS: ref #284404
2018-10-27 05:13:51 [DEBUG   ] summary = ERROR
2018-10-27 05:13:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284404  13 58418 18831301 A  ERRORERROR'
2018-10-27 05:13:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 05:13:51 [DEBUG   ] Got command RPT from MCS: ref #284405
2018-10-27 05:13:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:13:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284405  77 58418 18831493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:13:51 [DEBUG   ] Got command RPT from MCS: ref #284406
2018-10-27 05:13:51 [DEBUG   ] summary = ERROR
2018-10-27 05:13:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284406  13 58418 18831697 A  ERRORERROR'
2018-10-27 05:13:51 [DEBUG   ] Got command RPT from MCS: ref #284408
2018-10-27 05:13:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:13:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284408  77 58418 18831901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:13:52 [DEBUG   ] Got command RPT from MCS: ref #284409
2018-10-27 05:13:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 05:13:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284409  12 58418 18832105 A  ERRORB•™š'
2018-10-27 05:14:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 05:14:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:14:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:14:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:14:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:14:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:14:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:14:30 [DEBUG   ] Finished updating board flags in 2.092 seconds
2018-10-27 05:14:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 05:14:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 05:15:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 05:15:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:15:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:15:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:15:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:15:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:15:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:15:30 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-10-27 05:15:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 05:15:37 [DEBUG   ] Got command RPT from MCS: ref #284418
2018-10-27 05:15:37 [DEBUG   ] summary = ERROR
2018-10-27 05:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284418  13 58418 18937629 A  ERRORERROR'
2018-10-27 05:15:37 [DEBUG   ] Got command RPT from MCS: ref #284419
2018-10-27 05:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284419  77 58418 18937630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:15:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 05:16:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 05:16:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:16:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:16:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:16:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:16:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:16:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:16:30 [DEBUG   ] Finished updating board flags in 1.932 seconds
2018-10-27 05:16:31 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 05:16:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 05:17:12 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-27 05:17:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:17:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:17:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:17:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:17:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:17:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:17:30 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-27 05:17:32 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-10-27 05:17:52 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-27 05:18:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 05:18:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:18:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:18:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:18:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:18:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:18:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:18:30 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-10-27 05:18:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 05:18:51 [DEBUG   ] Got command RPT from MCS: ref #284439
2018-10-27 05:18:51 [DEBUG   ] summary = ERROR
2018-10-27 05:18:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284439  13 58418 19131381 A  ERRORERROR'
2018-10-27 05:18:51 [DEBUG   ] Got command RPT from MCS: ref #284440
2018-10-27 05:18:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:18:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284440  77 58418 19131585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:18:51 [DEBUG   ] Got command RPT from MCS: ref #284441
2018-10-27 05:18:51 [DEBUG   ] summary = ERROR
2018-10-27 05:18:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284441  13 58418 19131778 A  ERRORERROR'
2018-10-27 05:18:51 [DEBUG   ] Got command RPT from MCS: ref #284442
2018-10-27 05:18:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:18:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284442  77 58418 19131981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:18:52 [DEBUG   ] Got command RPT from MCS: ref #284443
2018-10-27 05:18:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 05:18:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284443  12 58418 19132185 A  ERRORB–™š'
2018-10-27 05:18:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 05:19:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 05:19:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:19:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:19:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:19:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:19:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:19:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:19:30 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-10-27 05:19:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 05:19:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 05:20:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 05:20:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:20:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:20:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:20:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:20:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:20:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:20:30 [DEBUG   ] Finished updating board flags in 1.597 seconds
2018-10-27 05:20:32 [DEBUG   ] Finished updating ant stats in 0.592 seconds
2018-10-27 05:20:37 [DEBUG   ] Got command RPT from MCS: ref #284448
2018-10-27 05:20:37 [DEBUG   ] summary = ERROR
2018-10-27 05:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284448  13 58418 19237621 A  ERRORERROR'
2018-10-27 05:20:37 [DEBUG   ] Got command RPT from MCS: ref #284449
2018-10-27 05:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284449  77 58418 19237622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:20:53 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-27 05:21:13 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-10-27 05:21:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 05:21:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:21:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 05:21:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:21:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:21:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:21:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:21:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:21:30 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-10-27 05:21:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 05:21:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 05:22:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 05:22:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:22:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:22:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:22:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:22:30 [WARNING ] (13, 1, 'bot')
2018-10-27 05:22:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:22:30 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-10-27 05:22:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 05:22:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 05:23:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 05:23:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:23:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:23:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:23:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:23:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:23:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:23:31 [DEBUG   ] Finished updating board flags in 2.059 seconds
2018-10-27 05:23:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 05:23:51 [DEBUG   ] Got command RPT from MCS: ref #284471
2018-10-27 05:23:51 [DEBUG   ] summary = ERROR
2018-10-27 05:23:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284471  13 58418 19431473 A  ERRORERROR'
2018-10-27 05:23:51 [DEBUG   ] Got command RPT from MCS: ref #284472
2018-10-27 05:23:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:23:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284472  77 58418 19431665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:23:51 [DEBUG   ] Got command RPT from MCS: ref #284473
2018-10-27 05:23:51 [DEBUG   ] summary = ERROR
2018-10-27 05:23:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284473  13 58418 19431869 A  ERRORERROR'
2018-10-27 05:23:52 [DEBUG   ] Got command RPT from MCS: ref #284475
2018-10-27 05:23:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:23:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284475  77 58418 19432073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:23:52 [DEBUG   ] Got command RPT from MCS: ref #284477
2018-10-27 05:23:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 05:23:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284477  12 58418 19432265 A  ERRORB–™š'
2018-10-27 05:23:53 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 05:24:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 05:24:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:24:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:24:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:24:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:24:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:24:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:24:31 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-10-27 05:24:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 05:24:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 05:25:13 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 05:25:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:25:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 05:25:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:25:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:25:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:25:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:25:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:25:31 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-27 05:25:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 05:25:37 [DEBUG   ] Got command RPT from MCS: ref #284481
2018-10-27 05:25:37 [DEBUG   ] summary = ERROR
2018-10-27 05:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284481  13 58418 19537633 A  ERRORERROR'
2018-10-27 05:25:37 [DEBUG   ] Got command RPT from MCS: ref #284482
2018-10-27 05:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284482  77 58418 19537634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:25:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 05:26:14 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-27 05:26:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:26:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 05:26:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:26:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:26:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:26:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:26:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:26:31 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-27 05:26:33 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-27 05:26:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-27 05:27:14 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 05:27:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:27:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:27:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:27:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:27:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:27:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:27:31 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-10-27 05:27:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-27 05:27:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 05:28:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 05:28:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:28:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:28:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:28:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:28:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:28:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:28:31 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-10-27 05:28:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 05:28:51 [DEBUG   ] Got command RPT from MCS: ref #284502
2018-10-27 05:28:51 [DEBUG   ] summary = ERROR
2018-10-27 05:28:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284502  13 58418 19731557 A  ERRORERROR'
2018-10-27 05:28:51 [DEBUG   ] Got command RPT from MCS: ref #284503
2018-10-27 05:28:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:28:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284503  77 58418 19731749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:28:51 [DEBUG   ] Got command RPT from MCS: ref #284504
2018-10-27 05:28:51 [DEBUG   ] summary = ERROR
2018-10-27 05:28:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284504  13 58418 19731953 A  ERRORERROR'
2018-10-27 05:28:52 [DEBUG   ] Got command RPT from MCS: ref #284505
2018-10-27 05:28:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:28:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284505  77 58418 19732157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:28:52 [DEBUG   ] Got command RPT from MCS: ref #284506
2018-10-27 05:28:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 05:28:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284506  12 58418 19732361 A  ERRORB•™š'
2018-10-27 05:28:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 05:29:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 05:29:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:29:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:29:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:29:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:29:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:29:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:29:31 [DEBUG   ] Finished updating board flags in 1.462 seconds
2018-10-27 05:29:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 05:29:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 05:30:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 05:30:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:30:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 05:30:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:30:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:30:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:30:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:30:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:30:31 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-10-27 05:30:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 05:30:37 [DEBUG   ] Got command RPT from MCS: ref #284511
2018-10-27 05:30:37 [DEBUG   ] summary = ERROR
2018-10-27 05:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284511  13 58418 19837629 A  ERRORERROR'
2018-10-27 05:30:37 [DEBUG   ] Got command RPT from MCS: ref #284512
2018-10-27 05:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284512  77 58418 19837630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:30:54 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 05:31:14 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-27 05:31:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:31:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:31:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:31:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:31:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:31:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:31:31 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-10-27 05:31:35 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-27 05:31:55 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 05:32:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 05:32:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:32:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:32:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:32:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:32:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:32:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:32:31 [DEBUG   ] Finished updating board flags in 1.442 seconds
2018-10-27 05:32:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 05:32:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 05:33:15 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 05:33:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:33:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:33:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:33:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:33:31 [WARNING ] (13, 1, 'bot')
2018-10-27 05:33:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:33:31 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-10-27 05:33:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 05:33:51 [DEBUG   ] Got command RPT from MCS: ref #284534
2018-10-27 05:33:51 [DEBUG   ] summary = ERROR
2018-10-27 05:33:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284534  13 58418 20031645 A  ERRORERROR'
2018-10-27 05:33:51 [DEBUG   ] Got command RPT from MCS: ref #284535
2018-10-27 05:33:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:33:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284535  77 58418 20031837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:33:52 [DEBUG   ] Got command RPT from MCS: ref #284536
2018-10-27 05:33:52 [DEBUG   ] summary = ERROR
2018-10-27 05:33:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284536  13 58418 20032041 A  ERRORERROR'
2018-10-27 05:33:52 [DEBUG   ] Got command RPT from MCS: ref #284538
2018-10-27 05:33:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:33:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284538  77 58418 20032245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:33:52 [DEBUG   ] Got command RPT from MCS: ref #284539
2018-10-27 05:33:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 05:33:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284539  12 58418 20032449 A  ERRORB•™š'
2018-10-27 05:33:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 05:34:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 05:34:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:34:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:34:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:34:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:34:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:34:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:34:32 [DEBUG   ] Finished updating board flags in 2.249 seconds
2018-10-27 05:34:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 05:34:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 05:35:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 05:35:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:35:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:35:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:35:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:35:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:35:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:35:32 [DEBUG   ] Finished updating board flags in 2.207 seconds
2018-10-27 05:35:35 [DEBUG   ] Finished updating ant stats in 0.591 seconds
2018-10-27 05:35:37 [DEBUG   ] Got command RPT from MCS: ref #284548
2018-10-27 05:35:37 [DEBUG   ] summary = ERROR
2018-10-27 05:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284548  13 58418 20137629 A  ERRORERROR'
2018-10-27 05:35:37 [DEBUG   ] Got command RPT from MCS: ref #284549
2018-10-27 05:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284549  77 58418 20137630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:35:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 05:36:15 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-10-27 05:36:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:36:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:36:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:36:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:36:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:36:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:36:32 [DEBUG   ] Finished updating board flags in 2.117 seconds
2018-10-27 05:36:36 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-27 05:36:56 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 05:37:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 05:37:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:37:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:37:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:37:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:37:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:37:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:37:32 [DEBUG   ] Finished updating board flags in 2.020 seconds
2018-10-27 05:37:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 05:37:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 05:38:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 05:38:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:38:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 05:38:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 05:38:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:38:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:38:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:38:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:38:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:38:32 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-10-27 05:38:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 05:38:51 [DEBUG   ] Got command RPT from MCS: ref #284569
2018-10-27 05:38:51 [DEBUG   ] summary = ERROR
2018-10-27 05:38:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284569  13 58418 20331725 A  ERRORERROR'
2018-10-27 05:38:51 [DEBUG   ] Got command RPT from MCS: ref #284570
2018-10-27 05:38:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:38:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284570  77 58418 20331929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:38:52 [DEBUG   ] Got command RPT from MCS: ref #284571
2018-10-27 05:38:52 [DEBUG   ] summary = ERROR
2018-10-27 05:38:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284571  13 58418 20332133 A  ERRORERROR'
2018-10-27 05:38:52 [DEBUG   ] Got command RPT from MCS: ref #284572
2018-10-27 05:38:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:38:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284572  77 58418 20332325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:38:52 [DEBUG   ] Got command RPT from MCS: ref #284573
2018-10-27 05:38:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 05:38:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284573  12 58418 20332529 A  ERRORB•™š'
2018-10-27 05:38:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 05:39:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 05:39:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:39:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:39:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:39:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:39:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:39:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:39:32 [DEBUG   ] Finished updating board flags in 1.839 seconds
2018-10-27 05:39:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 05:39:56 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 05:40:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 05:40:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:40:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:40:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:40:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:40:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:40:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:40:32 [DEBUG   ] Finished updating board flags in 1.769 seconds
2018-10-27 05:40:36 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-10-27 05:40:37 [DEBUG   ] Got command RPT from MCS: ref #284574
2018-10-27 05:40:37 [DEBUG   ] summary = ERROR
2018-10-27 05:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284574  13 58418 20437629 A  ERRORERROR'
2018-10-27 05:40:37 [DEBUG   ] Got command RPT from MCS: ref #284575
2018-10-27 05:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284575  77 58418 20437630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:40:57 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-27 05:41:17 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 05:41:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:41:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 05:41:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:41:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:41:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:41:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:41:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:41:32 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-27 05:41:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 05:41:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 05:42:17 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-10-27 05:42:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 05:42:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:42:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:42:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:42:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:42:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:42:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:42:32 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-10-27 05:42:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 05:42:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 05:43:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 05:43:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:43:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:43:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:43:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:43:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:43:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:43:32 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-10-27 05:43:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 05:43:51 [DEBUG   ] Got command RPT from MCS: ref #284597
2018-10-27 05:43:51 [DEBUG   ] summary = ERROR
2018-10-27 05:43:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284597  13 58418 20631817 A  ERRORERROR'
2018-10-27 05:43:52 [DEBUG   ] Got command RPT from MCS: ref #284598
2018-10-27 05:43:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:43:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284598  77 58418 20632009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:43:52 [DEBUG   ] Got command RPT from MCS: ref #284599
2018-10-27 05:43:52 [DEBUG   ] summary = ERROR
2018-10-27 05:43:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284599  13 58418 20632213 A  ERRORERROR'
2018-10-27 05:43:52 [DEBUG   ] Got command RPT from MCS: ref #284601
2018-10-27 05:43:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:43:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284601  77 58418 20632417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:43:52 [DEBUG   ] Got command RPT from MCS: ref #284602
2018-10-27 05:43:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 05:43:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284602  12 58418 20632621 A  ERRORB–™š'
2018-10-27 05:43:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 05:44:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 05:44:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:44:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:44:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:44:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:44:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:44:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:44:32 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-10-27 05:44:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 05:44:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 05:45:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 05:45:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:45:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:45:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:45:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:45:32 [WARNING ] (13, 1, 'bot')
2018-10-27 05:45:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:45:32 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-10-27 05:45:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 05:45:37 [DEBUG   ] Got command RPT from MCS: ref #284611
2018-10-27 05:45:37 [DEBUG   ] summary = ERROR
2018-10-27 05:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284611  13 58418 20737629 A  ERRORERROR'
2018-10-27 05:45:37 [DEBUG   ] Got command RPT from MCS: ref #284612
2018-10-27 05:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284612  77 58418 20737630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:45:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 05:46:17 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-27 05:46:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:46:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:46:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:46:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:46:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:46:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:46:33 [DEBUG   ] Finished updating board flags in 2.051 seconds
2018-10-27 05:46:38 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-27 05:46:58 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 05:47:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 05:47:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:47:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:47:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:47:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:47:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:47:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:47:33 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-10-27 05:47:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 05:47:58 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 05:48:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 05:48:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:48:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:48:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:48:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:48:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:48:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:48:33 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-10-27 05:48:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 05:48:51 [DEBUG   ] Got command RPT from MCS: ref #284632
2018-10-27 05:48:51 [DEBUG   ] summary = ERROR
2018-10-27 05:48:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284632  13 58418 20931901 A  ERRORERROR'
2018-10-27 05:48:52 [DEBUG   ] Got command RPT from MCS: ref #284633
2018-10-27 05:48:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:48:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284633  77 58418 20932093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:48:52 [DEBUG   ] Got command RPT from MCS: ref #284634
2018-10-27 05:48:52 [DEBUG   ] summary = ERROR
2018-10-27 05:48:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284634  13 58418 20932297 A  ERRORERROR'
2018-10-27 05:48:52 [DEBUG   ] Got command RPT from MCS: ref #284635
2018-10-27 05:48:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:48:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284635  77 58418 20932501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:48:52 [DEBUG   ] Got command RPT from MCS: ref #284636
2018-10-27 05:48:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 05:48:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284636  12 58418 20932705 A  ERRORB–™š'
2018-10-27 05:48:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 05:49:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 05:49:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:49:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:49:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:49:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:49:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:49:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:49:33 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-27 05:49:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 05:49:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 05:50:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 05:50:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:50:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:50:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:50:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:50:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:50:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:50:33 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-10-27 05:50:37 [DEBUG   ] Got command RPT from MCS: ref #284641
2018-10-27 05:50:37 [DEBUG   ] summary = ERROR
2018-10-27 05:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284641  13 58418 21037633 A  ERRORERROR'
2018-10-27 05:50:37 [DEBUG   ] Got command RPT from MCS: ref #284642
2018-10-27 05:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284642  77 58418 21037634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:50:38 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-10-27 05:50:59 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 05:51:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 05:51:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:51:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:51:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:51:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:51:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:51:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:51:33 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-10-27 05:51:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 05:51:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 05:52:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 05:52:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:52:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 05:52:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:52:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:52:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:52:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:52:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:52:33 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-10-27 05:52:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 05:52:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 05:53:19 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-10-27 05:53:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:53:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:53:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:53:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:53:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:53:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:53:33 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-10-27 05:53:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 05:53:51 [DEBUG   ] Got command RPT from MCS: ref #284664
2018-10-27 05:53:51 [DEBUG   ] summary = ERROR
2018-10-27 05:53:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284664  13 58418 21231977 A  ERRORERROR'
2018-10-27 05:53:52 [DEBUG   ] Got command RPT from MCS: ref #284665
2018-10-27 05:53:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:53:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284665  77 58418 21232181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:53:52 [DEBUG   ] Got command RPT from MCS: ref #284666
2018-10-27 05:53:52 [DEBUG   ] summary = ERROR
2018-10-27 05:53:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284666  13 58418 21232385 A  ERRORERROR'
2018-10-27 05:53:52 [DEBUG   ] Got command RPT from MCS: ref #284668
2018-10-27 05:53:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:53:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284668  77 58418 21232589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:53:52 [DEBUG   ] Got command RPT from MCS: ref #284670
2018-10-27 05:53:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 05:53:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284670  12 58418 21232781 A  ERRORB•™š'
2018-10-27 05:53:59 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-10-27 05:54:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 05:54:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:54:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:54:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:54:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:54:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:54:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:54:33 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-10-27 05:54:39 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-27 05:54:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 05:55:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 05:55:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 05:55:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:55:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 05:55:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:55:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:55:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:55:33 [WARNING ] (13, 1, 'bot')
2018-10-27 05:55:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:55:33 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-10-27 05:55:37 [DEBUG   ] Got command RPT from MCS: ref #284674
2018-10-27 05:55:37 [DEBUG   ] summary = ERROR
2018-10-27 05:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284674  13 58418 21337633 A  ERRORERROR'
2018-10-27 05:55:37 [DEBUG   ] Got command RPT from MCS: ref #284675
2018-10-27 05:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284675  77 58418 21337634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:55:40 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-27 05:55:59 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-10-27 05:56:20 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 05:56:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:56:34 [WARNING ] (13, 1, 'bot')
2018-10-27 05:56:34 [WARNING ] (13, 1, 'bot')
2018-10-27 05:56:34 [WARNING ] (13, 1, 'bot')
2018-10-27 05:56:34 [WARNING ] (13, 1, 'bot')
2018-10-27 05:56:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:56:34 [DEBUG   ] Finished updating board flags in 2.044 seconds
2018-10-27 05:56:40 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-27 05:57:00 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 05:57:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 05:57:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 05:57:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:57:34 [WARNING ] (13, 1, 'bot')
2018-10-27 05:57:34 [WARNING ] (13, 1, 'bot')
2018-10-27 05:57:34 [WARNING ] (13, 1, 'bot')
2018-10-27 05:57:34 [WARNING ] (13, 1, 'bot')
2018-10-27 05:57:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:57:34 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-10-27 05:57:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 05:58:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 05:58:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 05:58:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:58:34 [WARNING ] (13, 1, 'bot')
2018-10-27 05:58:34 [WARNING ] (13, 1, 'bot')
2018-10-27 05:58:34 [WARNING ] (13, 1, 'bot')
2018-10-27 05:58:34 [WARNING ] (13, 1, 'bot')
2018-10-27 05:58:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:58:34 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-10-27 05:58:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 05:58:52 [DEBUG   ] Got command RPT from MCS: ref #284695
2018-10-27 05:58:52 [DEBUG   ] summary = ERROR
2018-10-27 05:58:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284695  13 58418 21532073 A  ERRORERROR'
2018-10-27 05:58:52 [DEBUG   ] Got command RPT from MCS: ref #284696
2018-10-27 05:58:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:58:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284696  77 58418 21532265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:58:52 [DEBUG   ] Got command RPT from MCS: ref #284697
2018-10-27 05:58:52 [DEBUG   ] summary = ERROR
2018-10-27 05:58:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284697  13 58418 21532469 A  ERRORERROR'
2018-10-27 05:58:52 [DEBUG   ] Got command RPT from MCS: ref #284698
2018-10-27 05:58:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 05:58:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284698  77 58418 21532673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 05:58:52 [DEBUG   ] Got command RPT from MCS: ref #284699
2018-10-27 05:58:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 05:58:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284699  12 58418 21532877 A  ERRORB—™š'
2018-10-27 05:59:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 05:59:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 05:59:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 05:59:34 [WARNING ] (13, 1, 'bot')
2018-10-27 05:59:34 [WARNING ] (13, 1, 'bot')
2018-10-27 05:59:34 [WARNING ] (13, 1, 'bot')
2018-10-27 05:59:34 [WARNING ] (13, 1, 'bot')
2018-10-27 05:59:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 05:59:34 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-27 05:59:40 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-10-27 06:00:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 06:00:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 06:00:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:00:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:00:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:00:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:00:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:00:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:00:34 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-10-27 06:00:37 [DEBUG   ] Got command RPT from MCS: ref #284704
2018-10-27 06:00:37 [DEBUG   ] summary = ERROR
2018-10-27 06:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284704  13 58418 21637641 A  ERRORERROR'
2018-10-27 06:00:37 [DEBUG   ] Got command RPT from MCS: ref #284705
2018-10-27 06:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284705  77 58418 21637642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:00:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 06:01:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 06:01:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 06:01:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:01:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:01:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:01:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:01:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:01:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:01:34 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-10-27 06:01:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 06:02:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 06:02:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 06:02:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 06:02:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:02:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:02:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:02:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:02:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:02:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:02:34 [DEBUG   ] Finished updating board flags in 1.566 seconds
2018-10-27 06:02:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 06:03:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 06:03:20 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-27 06:03:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:03:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:03:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:03:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:03:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:03:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:03:34 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-27 06:03:41 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-27 06:03:52 [DEBUG   ] Got command RPT from MCS: ref #284727
2018-10-27 06:03:52 [DEBUG   ] summary = ERROR
2018-10-27 06:03:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284727  13 58418 21832157 A  ERRORERROR'
2018-10-27 06:03:52 [DEBUG   ] Got command RPT from MCS: ref #284728
2018-10-27 06:03:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:03:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284728  77 58418 21832349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:03:52 [DEBUG   ] Got command RPT from MCS: ref #284729
2018-10-27 06:03:52 [DEBUG   ] summary = ERROR
2018-10-27 06:03:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284729  13 58418 21832553 A  ERRORERROR'
2018-10-27 06:03:52 [DEBUG   ] Got command RPT from MCS: ref #284731
2018-10-27 06:03:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:03:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284731  77 58418 21832757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:03:52 [DEBUG   ] Got command RPT from MCS: ref #284733
2018-10-27 06:03:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 06:03:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284733  12 58418 21832961 A  ERRORB–™š'
2018-10-27 06:04:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 06:04:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 06:04:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:04:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:04:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:04:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:04:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:04:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:04:34 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-10-27 06:04:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 06:05:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 06:05:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 06:05:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:05:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:05:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:05:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:05:34 [WARNING ] (13, 1, 'bot')
2018-10-27 06:05:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:05:34 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-10-27 06:05:37 [DEBUG   ] Got command RPT from MCS: ref #284741
2018-10-27 06:05:37 [DEBUG   ] summary = ERROR
2018-10-27 06:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284741  13 58418 21937633 A  ERRORERROR'
2018-10-27 06:05:37 [DEBUG   ] Got command RPT from MCS: ref #284742
2018-10-27 06:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284742  77 58418 21937634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:05:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 06:06:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 06:06:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 06:06:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:06:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:06:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:06:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:06:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:06:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:06:35 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-10-27 06:06:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 06:07:01 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-10-27 06:07:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 06:07:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:07:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:07:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:07:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:07:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:07:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:07:35 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-27 06:07:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 06:08:01 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 06:08:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 06:08:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:08:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:08:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:08:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:08:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:08:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:08:35 [DEBUG   ] Finished updating board flags in 1.833 seconds
2018-10-27 06:08:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 06:08:52 [DEBUG   ] Got command RPT from MCS: ref #284762
2018-10-27 06:08:52 [DEBUG   ] summary = ERROR
2018-10-27 06:08:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284762  13 58418 22132233 A  ERRORERROR'
2018-10-27 06:08:52 [DEBUG   ] Got command RPT from MCS: ref #284763
2018-10-27 06:08:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:08:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284763  77 58418 22132437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:08:52 [DEBUG   ] Got command RPT from MCS: ref #284764
2018-10-27 06:08:52 [DEBUG   ] summary = ERROR
2018-10-27 06:08:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284764  13 58418 22132641 A  ERRORERROR'
2018-10-27 06:08:52 [DEBUG   ] Got command RPT from MCS: ref #284765
2018-10-27 06:08:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:08:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284765  77 58418 22132845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:08:53 [DEBUG   ] Got command RPT from MCS: ref #284766
2018-10-27 06:08:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 06:08:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284766  12 58418 22133037 A  ERRORB•™š'
2018-10-27 06:09:01 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 06:09:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 06:09:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:09:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:09:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:09:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:09:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:09:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:09:35 [DEBUG   ] Finished updating board flags in 1.828 seconds
2018-10-27 06:09:41 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-27 06:10:02 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-27 06:10:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 06:10:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:10:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:10:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:10:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:10:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:10:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:10:35 [DEBUG   ] Finished updating board flags in 1.750 seconds
2018-10-27 06:10:37 [DEBUG   ] Got command RPT from MCS: ref #284767
2018-10-27 06:10:37 [DEBUG   ] summary = ERROR
2018-10-27 06:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284767  13 58418 22237637 A  ERRORERROR'
2018-10-27 06:10:37 [DEBUG   ] Got command RPT from MCS: ref #284768
2018-10-27 06:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284768  77 58418 22237638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:10:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 06:11:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 06:11:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 06:11:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:11:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:11:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:11:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:11:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:11:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:11:35 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-10-27 06:11:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 06:12:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 06:12:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 06:12:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:12:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:12:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:12:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:12:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:12:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:12:35 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-10-27 06:12:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 06:13:02 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 06:13:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 06:13:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:13:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:13:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:13:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:13:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:13:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:13:35 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-27 06:13:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 06:13:52 [DEBUG   ] Got command RPT from MCS: ref #284790
2018-10-27 06:13:52 [DEBUG   ] summary = ERROR
2018-10-27 06:13:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284790  13 58418 22432329 A  ERRORERROR'
2018-10-27 06:13:52 [DEBUG   ] Got command RPT from MCS: ref #284791
2018-10-27 06:13:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:13:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284791  77 58418 22432521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:13:52 [DEBUG   ] Got command RPT from MCS: ref #284792
2018-10-27 06:13:52 [DEBUG   ] summary = ERROR
2018-10-27 06:13:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284792  13 58418 22432725 A  ERRORERROR'
2018-10-27 06:13:52 [DEBUG   ] Got command RPT from MCS: ref #284794
2018-10-27 06:13:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:13:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284794  77 58418 22432929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:13:53 [DEBUG   ] Got command RPT from MCS: ref #284795
2018-10-27 06:13:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 06:13:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284795  12 58418 22433133 A  ERRORB•™š'
2018-10-27 06:14:02 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 06:14:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 06:14:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:14:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:14:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:14:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:14:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:14:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:14:35 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-10-27 06:14:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 06:15:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 06:15:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 06:15:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:15:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:15:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:15:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:15:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:15:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:15:35 [DEBUG   ] Finished updating board flags in 1.443 seconds
2018-10-27 06:15:37 [DEBUG   ] Got command RPT from MCS: ref #284804
2018-10-27 06:15:37 [DEBUG   ] summary = ERROR
2018-10-27 06:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284804  13 58418 22537641 A  ERRORERROR'
2018-10-27 06:15:37 [DEBUG   ] Got command RPT from MCS: ref #284805
2018-10-27 06:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284805  77 58418 22537642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:15:42 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 06:16:03 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 06:16:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 06:16:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:16:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:16:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:16:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:16:35 [WARNING ] (13, 1, 'bot')
2018-10-27 06:16:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:16:35 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-10-27 06:16:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 06:17:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 06:17:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 06:17:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:17:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:17:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:17:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:17:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:17:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:17:36 [DEBUG   ] Finished updating board flags in 2.383 seconds
2018-10-27 06:17:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 06:18:03 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-10-27 06:18:23 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 06:18:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:18:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:18:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:18:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:18:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:18:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:18:36 [DEBUG   ] Finished updating board flags in 2.145 seconds
2018-10-27 06:18:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 06:18:52 [DEBUG   ] Got command RPT from MCS: ref #284825
2018-10-27 06:18:52 [DEBUG   ] summary = ERROR
2018-10-27 06:18:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284825  13 58418 22732409 A  ERRORERROR'
2018-10-27 06:18:52 [DEBUG   ] Got command RPT from MCS: ref #284826
2018-10-27 06:18:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:18:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284826  77 58418 22732613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:18:52 [DEBUG   ] Got command RPT from MCS: ref #284827
2018-10-27 06:18:52 [DEBUG   ] summary = ERROR
2018-10-27 06:18:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284827  13 58418 22732817 A  ERRORERROR'
2018-10-27 06:18:53 [DEBUG   ] Got command RPT from MCS: ref #284828
2018-10-27 06:18:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:18:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284828  77 58418 22733009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:18:53 [DEBUG   ] Got command RPT from MCS: ref #284829
2018-10-27 06:18:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 06:18:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284829  12 58418 22733213 A  ERRORB–™š'
2018-10-27 06:19:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 06:19:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 06:19:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:19:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 06:19:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:19:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:19:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:19:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:19:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:19:36 [DEBUG   ] Finished updating board flags in 2.020 seconds
2018-10-27 06:19:43 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-10-27 06:20:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 06:20:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 06:20:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:20:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 06:20:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:20:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:20:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:20:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:20:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:20:36 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-10-27 06:20:37 [DEBUG   ] Got command RPT from MCS: ref #284834
2018-10-27 06:20:37 [DEBUG   ] summary = ERROR
2018-10-27 06:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284834  13 58418 22837641 A  ERRORERROR'
2018-10-27 06:20:37 [DEBUG   ] Got command RPT from MCS: ref #284835
2018-10-27 06:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284835  77 58418 22837642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:20:44 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-10-27 06:21:04 [DEBUG   ] Finished updating ant stats in 1.379 seconds
2018-10-27 06:21:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 06:21:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:21:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:21:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:21:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:21:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:21:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:21:36 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-27 06:21:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 06:22:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 06:22:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 06:22:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:22:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:22:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:22:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:22:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:22:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:22:36 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-10-27 06:22:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 06:23:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 06:23:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 06:23:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:23:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:23:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:23:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:23:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:23:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:23:36 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-10-27 06:23:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 06:23:52 [DEBUG   ] Got command RPT from MCS: ref #284857
2018-10-27 06:23:52 [DEBUG   ] summary = ERROR
2018-10-27 06:23:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284857  13 58418 23032493 A  ERRORERROR'
2018-10-27 06:23:52 [DEBUG   ] Got command RPT from MCS: ref #284858
2018-10-27 06:23:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:23:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284858  77 58418 23032697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:23:52 [DEBUG   ] Got command RPT from MCS: ref #284859
2018-10-27 06:23:52 [DEBUG   ] summary = ERROR
2018-10-27 06:23:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284859  13 58418 23032901 A  ERRORERROR'
2018-10-27 06:23:53 [DEBUG   ] Got command RPT from MCS: ref #284861
2018-10-27 06:23:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:23:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284861  77 58418 23033093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:23:53 [DEBUG   ] Got command RPT from MCS: ref #284862
2018-10-27 06:23:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 06:23:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284862  12 58418 23033297 A  ERRORB–™š'
2018-10-27 06:24:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 06:24:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 06:24:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:24:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:24:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:24:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:24:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:24:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:24:36 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-10-27 06:24:44 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 06:25:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 06:25:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 06:25:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:25:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:25:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:25:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:25:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:25:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:25:36 [DEBUG   ] Finished updating board flags in 1.570 seconds
2018-10-27 06:25:37 [DEBUG   ] Got command RPT from MCS: ref #284867
2018-10-27 06:25:37 [DEBUG   ] summary = ERROR
2018-10-27 06:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284867  13 58418 23137649 A  ERRORERROR'
2018-10-27 06:25:37 [DEBUG   ] Got command RPT from MCS: ref #284868
2018-10-27 06:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284868  77 58418 23137650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:25:44 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 06:26:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 06:26:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 06:26:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:26:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:26:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:26:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:26:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:26:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:26:36 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-10-27 06:26:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 06:27:05 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-27 06:27:25 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 06:27:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:27:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:27:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:27:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:27:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:27:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:27:36 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-10-27 06:27:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 06:28:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 06:28:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 06:28:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:28:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:28:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:28:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:28:36 [WARNING ] (13, 1, 'bot')
2018-10-27 06:28:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:28:36 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-10-27 06:28:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 06:28:52 [DEBUG   ] Got command RPT from MCS: ref #284888
2018-10-27 06:28:52 [DEBUG   ] summary = ERROR
2018-10-27 06:28:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284888  13 58418 23332581 A  ERRORERROR'
2018-10-27 06:28:52 [DEBUG   ] Got command RPT from MCS: ref #284889
2018-10-27 06:28:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:28:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284889  77 58418 23332785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:28:52 [DEBUG   ] Got command RPT from MCS: ref #284890
2018-10-27 06:28:52 [DEBUG   ] summary = ERROR
2018-10-27 06:28:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284890  13 58418 23332977 A  ERRORERROR'
2018-10-27 06:28:53 [DEBUG   ] Got command RPT from MCS: ref #284891
2018-10-27 06:28:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:28:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284891  77 58418 23333181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:28:53 [DEBUG   ] Got command RPT from MCS: ref #284892
2018-10-27 06:28:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 06:28:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284892  12 58418 23333385 A  ERRORB•™š'
2018-10-27 06:29:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 06:29:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 06:29:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:29:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 06:29:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:29:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:29:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:29:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:29:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:29:37 [DEBUG   ] Finished updating board flags in 2.048 seconds
2018-10-27 06:29:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 06:30:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 06:30:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 06:30:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:30:37 [DEBUG   ] Got command RPT from MCS: ref #284897
2018-10-27 06:30:37 [DEBUG   ] summary = ERROR
2018-10-27 06:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284897  13 58418 23437649 A  ERRORERROR'
2018-10-27 06:30:37 [DEBUG   ] Got command RPT from MCS: ref #284898
2018-10-27 06:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284898  77 58418 23437650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:30:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:30:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:30:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:30:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:30:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:30:37 [DEBUG   ] Finished updating board flags in 2.052 seconds
2018-10-27 06:30:45 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 06:31:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 06:31:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 06:31:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:31:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:31:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:31:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:31:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:31:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:31:37 [DEBUG   ] Finished updating board flags in 1.936 seconds
2018-10-27 06:31:45 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-10-27 06:32:06 [DEBUG   ] Finished updating ant stats in 1.406 seconds
2018-10-27 06:32:26 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-10-27 06:32:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:32:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:32:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:32:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:32:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:32:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:32:37 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-10-27 06:32:46 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-27 06:33:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 06:33:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 06:33:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:33:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:33:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:33:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:33:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:33:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:33:37 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-27 06:33:46 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-10-27 06:33:52 [DEBUG   ] Got command RPT from MCS: ref #284920
2018-10-27 06:33:52 [DEBUG   ] summary = ERROR
2018-10-27 06:33:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284920  13 58418 23632669 A  ERRORERROR'
2018-10-27 06:33:52 [DEBUG   ] Got command RPT from MCS: ref #284921
2018-10-27 06:33:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:33:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284921  77 58418 23632873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:33:53 [DEBUG   ] Got command RPT from MCS: ref #284922
2018-10-27 06:33:53 [DEBUG   ] summary = ERROR
2018-10-27 06:33:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284922  13 58418 23633065 A  ERRORERROR'
2018-10-27 06:33:53 [DEBUG   ] Got command RPT from MCS: ref #284924
2018-10-27 06:33:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:33:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284924  77 58418 23633269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:33:53 [DEBUG   ] Got command RPT from MCS: ref #284926
2018-10-27 06:33:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 06:33:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284926  12 58418 23633473 A  ERRORB•™š'
2018-10-27 06:34:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 06:34:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 06:34:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:34:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:34:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:34:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:34:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:34:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:34:37 [DEBUG   ] Finished updating board flags in 1.871 seconds
2018-10-27 06:34:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 06:35:06 [DEBUG   ] Finished updating ant stats in 1.188 seconds
2018-10-27 06:35:26 [DEBUG   ] Finished updating ant stats in 0.816 seconds
2018-10-27 06:35:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:35:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:35:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:35:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:35:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:35:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:35:37 [DEBUG   ] Finished updating board flags in 1.709 seconds
2018-10-27 06:35:37 [DEBUG   ] Got command RPT from MCS: ref #284934
2018-10-27 06:35:37 [DEBUG   ] summary = ERROR
2018-10-27 06:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284934  13 58418 23737645 A  ERRORERROR'
2018-10-27 06:35:37 [DEBUG   ] Got command RPT from MCS: ref #284935
2018-10-27 06:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284935  77 58418 23737646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:35:46 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-27 06:36:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 06:36:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 06:36:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:36:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:36:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:36:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:36:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:36:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:36:37 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-10-27 06:36:47 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-10-27 06:37:06 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-27 06:37:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 06:37:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:37:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:37:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:37:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:37:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:37:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:37:37 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-10-27 06:37:47 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-27 06:38:07 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-27 06:38:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 06:38:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:38:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 06:38:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:38:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:38:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:38:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:38:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:38:37 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-10-27 06:38:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 06:38:52 [DEBUG   ] Got command RPT from MCS: ref #284955
2018-10-27 06:38:52 [DEBUG   ] summary = ERROR
2018-10-27 06:38:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284955  13 58418 23932753 A  ERRORERROR'
2018-10-27 06:38:52 [DEBUG   ] Got command RPT from MCS: ref #284956
2018-10-27 06:38:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:38:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284956  77 58418 23932957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:38:53 [DEBUG   ] Got command RPT from MCS: ref #284957
2018-10-27 06:38:53 [DEBUG   ] summary = ERROR
2018-10-27 06:38:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284957  13 58418 23933161 A  ERRORERROR'
2018-10-27 06:38:53 [DEBUG   ] Got command RPT from MCS: ref #284958
2018-10-27 06:38:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:38:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284958  77 58418 23933353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:38:53 [DEBUG   ] Got command RPT from MCS: ref #284959
2018-10-27 06:38:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 06:38:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284959  12 58418 23933557 A  ERRORB•™š'
2018-10-27 06:39:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 06:39:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 06:39:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 06:39:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:39:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:39:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:39:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:39:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:39:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:39:37 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-10-27 06:39:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 06:40:07 [DEBUG   ] Finished updating ant stats in 0.609 seconds
2018-10-27 06:40:27 [DEBUG   ] Finished updating ant stats in 0.592 seconds
2018-10-27 06:40:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 06:40:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:40:37 [DEBUG   ] Got command RPT from MCS: ref #284960
2018-10-27 06:40:37 [DEBUG   ] summary = ERROR
2018-10-27 06:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284960  13 58418 24037641 A  ERRORERROR'
2018-10-27 06:40:37 [DEBUG   ] Got command RPT from MCS: ref #284961
2018-10-27 06:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284961  77 58418 24037642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:40:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:40:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:40:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:40:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:40:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:40:37 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-10-27 06:40:48 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-27 06:41:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 06:41:27 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 06:41:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:41:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:41:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:41:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:41:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:41:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:41:37 [DEBUG   ] Finished updating board flags in 1.435 seconds
2018-10-27 06:41:47 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 06:42:08 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-27 06:42:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 06:42:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:42:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 06:42:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 06:42:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:42:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:42:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:42:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:42:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:42:37 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-10-27 06:42:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 06:43:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 06:43:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 06:43:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:43:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:43:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:43:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:43:37 [WARNING ] (13, 1, 'bot')
2018-10-27 06:43:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:43:37 [DEBUG   ] Finished updating board flags in 1.458 seconds
2018-10-27 06:43:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 06:43:52 [DEBUG   ] Got command RPT from MCS: ref #284983
2018-10-27 06:43:52 [DEBUG   ] summary = ERROR
2018-10-27 06:43:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284983  13 58418 24232841 A  ERRORERROR'
2018-10-27 06:43:53 [DEBUG   ] Got command RPT from MCS: ref #284984
2018-10-27 06:43:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:43:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284984  77 58418 24233045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:43:53 [DEBUG   ] Got command RPT from MCS: ref #284985
2018-10-27 06:43:53 [DEBUG   ] summary = ERROR
2018-10-27 06:43:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284985  13 58418 24233249 A  ERRORERROR'
2018-10-27 06:43:53 [DEBUG   ] Got command RPT from MCS: ref #284987
2018-10-27 06:43:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:43:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284987  77 58418 24233441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:43:53 [DEBUG   ] Got command RPT from MCS: ref #284989
2018-10-27 06:43:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 06:43:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284989  12 58418 24233645 A  ERRORB—™š'
2018-10-27 06:44:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 06:44:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 06:44:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:44:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:44:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:44:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:44:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:44:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:44:38 [DEBUG   ] Finished updating board flags in 2.199 seconds
2018-10-27 06:44:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 06:45:08 [DEBUG   ] Finished updating ant stats in 0.812 seconds
2018-10-27 06:45:28 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2018-10-27 06:45:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:45:37 [DEBUG   ] Got command RPT from MCS: ref #284997
2018-10-27 06:45:37 [DEBUG   ] summary = ERROR
2018-10-27 06:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284997  13 58418 24337658 A  ERRORERROR'
2018-10-27 06:45:37 [DEBUG   ] Got command RPT from MCS: ref #284998
2018-10-27 06:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   284998  77 58418 24337658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:45:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:45:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:45:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:45:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:45:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:45:38 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-10-27 06:45:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 06:46:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 06:46:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 06:46:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:46:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:46:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:46:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:46:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:46:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:46:38 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-27 06:46:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 06:47:09 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-27 06:47:28 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 06:47:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:47:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:47:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:47:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:47:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:47:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:47:38 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-10-27 06:47:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 06:48:08 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-27 06:48:29 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-27 06:48:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:48:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:48:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:48:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:48:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:48:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:48:38 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-10-27 06:48:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 06:48:52 [DEBUG   ] Got command RPT from MCS: ref #285018
2018-10-27 06:48:52 [DEBUG   ] summary = ERROR
2018-10-27 06:48:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285018  13 58418 24532925 A  ERRORERROR'
2018-10-27 06:48:53 [DEBUG   ] Got command RPT from MCS: ref #285019
2018-10-27 06:48:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:48:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285019  77 58418 24533129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:48:53 [DEBUG   ] Got command RPT from MCS: ref #285020
2018-10-27 06:48:53 [DEBUG   ] summary = ERROR
2018-10-27 06:48:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285020  13 58418 24533321 A  ERRORERROR'
2018-10-27 06:48:53 [DEBUG   ] Got command RPT from MCS: ref #285021
2018-10-27 06:48:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:48:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285021  77 58418 24533525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:48:53 [DEBUG   ] Got command RPT from MCS: ref #285022
2018-10-27 06:48:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 06:48:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285022  12 58418 24533729 A  ERRORB–™š'
2018-10-27 06:49:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 06:49:29 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-27 06:49:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:49:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:49:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:49:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:49:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:49:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:49:38 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-10-27 06:49:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 06:50:09 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-27 06:50:29 [DEBUG   ] Finished updating ant stats in 1.176 seconds
2018-10-27 06:50:37 [DEBUG   ] Got command RPT from MCS: ref #285027
2018-10-27 06:50:37 [DEBUG   ] summary = ERROR
2018-10-27 06:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285027  13 58418 24637653 A  ERRORERROR'
2018-10-27 06:50:37 [DEBUG   ] Got command RPT from MCS: ref #285028
2018-10-27 06:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285028  77 58418 24637654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:50:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:50:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 06:50:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:50:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:50:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:50:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:50:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:50:38 [DEBUG   ] Finished updating board flags in 1.574 seconds
2018-10-27 06:50:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 06:51:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 06:51:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 06:51:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:51:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:51:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:51:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:51:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:51:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:51:38 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-27 06:51:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 06:52:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 06:52:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 06:52:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:52:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:52:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:52:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:52:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:52:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:52:38 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-10-27 06:52:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 06:53:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 06:53:29 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-10-27 06:53:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:53:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 06:53:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:53:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:53:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:53:38 [WARNING ] (13, 1, 'bot')
2018-10-27 06:53:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:53:38 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-10-27 06:53:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 06:53:53 [DEBUG   ] Got command RPT from MCS: ref #285050
2018-10-27 06:53:53 [DEBUG   ] summary = ERROR
2018-10-27 06:53:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285050  13 58418 24833009 A  ERRORERROR'
2018-10-27 06:53:53 [DEBUG   ] Got command RPT from MCS: ref #285051
2018-10-27 06:53:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:53:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285051  77 58418 24833213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:53:53 [DEBUG   ] Got command RPT from MCS: ref #285052
2018-10-27 06:53:53 [DEBUG   ] summary = ERROR
2018-10-27 06:53:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285052  13 58418 24833417 A  ERRORERROR'
2018-10-27 06:53:53 [DEBUG   ] Got command RPT from MCS: ref #285054
2018-10-27 06:53:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:53:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285054  77 58418 24833609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:53:53 [DEBUG   ] Got command RPT from MCS: ref #285055
2018-10-27 06:53:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 06:53:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285055  12 58418 24833813 A  ERRORB•™š'
2018-10-27 06:54:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 06:54:30 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-27 06:54:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:54:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 06:54:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:54:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:54:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:54:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:54:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:54:39 [DEBUG   ] Finished updating board flags in 2.059 seconds
2018-10-27 06:54:49 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-10-27 06:55:09 [DEBUG   ] Finished updating ant stats in 0.407 seconds
2018-10-27 06:55:30 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-27 06:55:37 [DEBUG   ] Got command RPT from MCS: ref #285060
2018-10-27 06:55:37 [DEBUG   ] summary = ERROR
2018-10-27 06:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285060  13 58418 24937653 A  ERRORERROR'
2018-10-27 06:55:37 [DEBUG   ] Got command RPT from MCS: ref #285061
2018-10-27 06:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285061  77 58418 24937654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:55:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:55:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:55:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:55:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:55:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:55:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:55:39 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-10-27 06:55:50 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 06:56:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 06:56:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 06:56:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:56:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:56:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:56:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:56:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:56:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:56:39 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-10-27 06:56:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 06:57:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 06:57:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 06:57:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:57:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:57:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:57:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:57:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:57:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:57:39 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-10-27 06:57:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 06:58:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 06:58:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 06:58:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:58:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:58:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:58:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:58:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:58:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:58:39 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-27 06:58:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 06:58:53 [DEBUG   ] Got command RPT from MCS: ref #285081
2018-10-27 06:58:53 [DEBUG   ] summary = ERROR
2018-10-27 06:58:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285081  13 58418 25133093 A  ERRORERROR'
2018-10-27 06:58:53 [DEBUG   ] Got command RPT from MCS: ref #285082
2018-10-27 06:58:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:58:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285082  77 58418 25133297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:58:53 [DEBUG   ] Got command RPT from MCS: ref #285083
2018-10-27 06:58:53 [DEBUG   ] summary = ERROR
2018-10-27 06:58:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285083  13 58418 25133501 A  ERRORERROR'
2018-10-27 06:58:53 [DEBUG   ] Got command RPT from MCS: ref #285084
2018-10-27 06:58:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 06:58:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285084  77 58418 25133705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 06:58:53 [DEBUG   ] Got command RPT from MCS: ref #285085
2018-10-27 06:58:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 06:58:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285085  12 58418 25133897 A  ERRORB•™š'
2018-10-27 06:59:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 06:59:31 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-27 06:59:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 06:59:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:59:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:59:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:59:39 [WARNING ] (13, 1, 'bot')
2018-10-27 06:59:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 06:59:39 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-10-27 06:59:51 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-10-27 07:00:11 [DEBUG   ] Finished updating ant stats in 1.218 seconds
2018-10-27 07:00:31 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-10-27 07:00:37 [DEBUG   ] Got command RPT from MCS: ref #285090
2018-10-27 07:00:37 [DEBUG   ] summary = ERROR
2018-10-27 07:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285090  13 58418 25237649 A  ERRORERROR'
2018-10-27 07:00:37 [DEBUG   ] Got command RPT from MCS: ref #285091
2018-10-27 07:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285091  77 58418 25237650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:00:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:00:39 [WARNING ] (13, 1, 'bot')
2018-10-27 07:00:39 [WARNING ] (13, 1, 'bot')
2018-10-27 07:00:39 [WARNING ] (13, 1, 'bot')
2018-10-27 07:00:39 [WARNING ] (13, 1, 'bot')
2018-10-27 07:00:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:00:39 [DEBUG   ] Finished updating board flags in 1.519 seconds
2018-10-27 07:00:51 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-10-27 07:01:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 07:01:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 07:01:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:01:39 [WARNING ] (13, 1, 'bot')
2018-10-27 07:01:39 [WARNING ] (13, 1, 'bot')
2018-10-27 07:01:39 [WARNING ] (13, 1, 'bot')
2018-10-27 07:01:39 [WARNING ] (13, 1, 'bot')
2018-10-27 07:01:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:01:39 [DEBUG   ] Finished updating board flags in 1.517 seconds
2018-10-27 07:01:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 07:02:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 07:02:31 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 07:02:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:02:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:02:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:02:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:02:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:02:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:02:40 [DEBUG   ] Finished updating board flags in 2.285 seconds
2018-10-27 07:02:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 07:03:11 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-27 07:03:31 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-27 07:03:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:03:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:03:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:03:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:03:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:03:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:03:40 [DEBUG   ] Finished updating board flags in 2.098 seconds
2018-10-27 07:03:52 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 07:03:53 [DEBUG   ] Got command RPT from MCS: ref #285113
2018-10-27 07:03:53 [DEBUG   ] summary = ERROR
2018-10-27 07:03:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285113  13 58418 25433181 A  ERRORERROR'
2018-10-27 07:03:53 [DEBUG   ] Got command RPT from MCS: ref #285114
2018-10-27 07:03:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:03:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285114  77 58418 25433385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:03:53 [DEBUG   ] Got command RPT from MCS: ref #285115
2018-10-27 07:03:53 [DEBUG   ] summary = ERROR
2018-10-27 07:03:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285115  13 58418 25433589 A  ERRORERROR'
2018-10-27 07:03:53 [DEBUG   ] Got command RPT from MCS: ref #285117
2018-10-27 07:03:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:03:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285117  77 58418 25433781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:03:53 [DEBUG   ] Got command RPT from MCS: ref #285119
2018-10-27 07:03:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 07:03:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285119  12 58418 25433985 A  ERRORB—™š'
2018-10-27 07:04:12 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-27 07:04:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 07:04:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:04:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:04:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:04:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:04:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:04:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:04:40 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-10-27 07:04:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 07:05:12 [DEBUG   ] Finished updating ant stats in 0.903 seconds
2018-10-27 07:05:32 [DEBUG   ] Finished updating ant stats in 0.702 seconds
2018-10-27 07:05:37 [DEBUG   ] Got command RPT from MCS: ref #285127
2018-10-27 07:05:37 [DEBUG   ] summary = ERROR
2018-10-27 07:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285127  13 58418 25537649 A  ERRORERROR'
2018-10-27 07:05:37 [DEBUG   ] Got command RPT from MCS: ref #285128
2018-10-27 07:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285128  77 58418 25537650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:05:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:05:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:05:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:05:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:05:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:05:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:05:40 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-10-27 07:05:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 07:06:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 07:06:32 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-27 07:06:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:06:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:06:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:06:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:06:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:06:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:06:40 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-10-27 07:06:53 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-27 07:07:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 07:07:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 07:07:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:07:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:07:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:07:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:07:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:07:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:07:40 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-10-27 07:07:53 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 07:08:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 07:08:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 07:08:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:08:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:08:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:08:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:08:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:08:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:08:40 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-27 07:08:53 [DEBUG   ] Got command RPT from MCS: ref #285148
2018-10-27 07:08:53 [DEBUG   ] summary = ERROR
2018-10-27 07:08:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285148  13 58418 25733261 A  ERRORERROR'
2018-10-27 07:08:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 07:08:53 [DEBUG   ] Got command RPT from MCS: ref #285149
2018-10-27 07:08:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:08:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285149  77 58418 25733465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:08:53 [DEBUG   ] Got command RPT from MCS: ref #285150
2018-10-27 07:08:53 [DEBUG   ] summary = ERROR
2018-10-27 07:08:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285150  13 58418 25733669 A  ERRORERROR'
2018-10-27 07:08:53 [DEBUG   ] Got command RPT from MCS: ref #285151
2018-10-27 07:08:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:08:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285151  77 58418 25733873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:08:54 [DEBUG   ] Got command RPT from MCS: ref #285152
2018-10-27 07:08:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 07:08:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285152  12 58418 25734065 A  ERRORB–™š'
2018-10-27 07:09:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 07:09:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 07:09:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:09:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:09:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:09:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:09:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:09:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:09:40 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-10-27 07:09:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 07:10:13 [DEBUG   ] Finished updating ant stats in 0.654 seconds
2018-10-27 07:10:33 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2018-10-27 07:10:37 [DEBUG   ] Got command RPT from MCS: ref #285153
2018-10-27 07:10:37 [DEBUG   ] summary = ERROR
2018-10-27 07:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285153  13 58418 25837653 A  ERRORERROR'
2018-10-27 07:10:37 [DEBUG   ] Got command RPT from MCS: ref #285154
2018-10-27 07:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285154  77 58418 25837654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:10:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:10:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:10:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:10:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:10:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:10:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:10:40 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-27 07:10:54 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-27 07:11:14 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 07:11:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 07:11:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:11:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:11:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:11:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:11:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:11:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:11:40 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-10-27 07:11:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 07:12:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 07:12:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 07:12:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:12:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:12:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:12:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:12:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:12:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:12:40 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-10-27 07:12:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-27 07:13:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 07:13:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 07:13:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:13:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:13:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:13:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:13:40 [WARNING ] (13, 1, 'bot')
2018-10-27 07:13:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:13:40 [DEBUG   ] Finished updating board flags in 1.349 seconds
2018-10-27 07:13:53 [DEBUG   ] Got command RPT from MCS: ref #285176
2018-10-27 07:13:53 [DEBUG   ] summary = ERROR
2018-10-27 07:13:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285176  13 58418 26033357 A  ERRORERROR'
2018-10-27 07:13:53 [DEBUG   ] Got command RPT from MCS: ref #285177
2018-10-27 07:13:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:13:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285177  77 58418 26033549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:13:53 [DEBUG   ] Got command RPT from MCS: ref #285178
2018-10-27 07:13:53 [DEBUG   ] summary = ERROR
2018-10-27 07:13:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285178  13 58418 26033754 A  ERRORERROR'
2018-10-27 07:13:53 [DEBUG   ] Got command RPT from MCS: ref #285180
2018-10-27 07:13:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:13:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285180  77 58418 26033957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:13:54 [DEBUG   ] Got command RPT from MCS: ref #285181
2018-10-27 07:13:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 07:13:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285181  12 58418 26034153 A  ERRORB•™š'
2018-10-27 07:13:54 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 07:14:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 07:14:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 07:14:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:14:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 07:14:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:14:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:14:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:14:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:14:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:14:41 [DEBUG   ] Finished updating board flags in 2.071 seconds
2018-10-27 07:14:55 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-27 07:15:15 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-27 07:15:35 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-27 07:15:37 [DEBUG   ] Got command RPT from MCS: ref #285190
2018-10-27 07:15:37 [DEBUG   ] summary = ERROR
2018-10-27 07:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285190  13 58418 26137657 A  ERRORERROR'
2018-10-27 07:15:37 [DEBUG   ] Got command RPT from MCS: ref #285191
2018-10-27 07:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285191  77 58418 26137658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:15:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:15:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:15:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:15:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:15:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:15:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:15:41 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-27 07:15:55 [DEBUG   ] Finished updating ant stats in 0.583 seconds
2018-10-27 07:16:16 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-27 07:16:36 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-27 07:16:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:16:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:16:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:16:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:16:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:16:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:16:41 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-27 07:16:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 07:17:16 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 07:17:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 07:17:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:17:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:17:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:17:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:17:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:17:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:17:41 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-27 07:17:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 07:18:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 07:18:36 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 07:18:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:18:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:18:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:18:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:18:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:18:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:18:41 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-27 07:18:53 [DEBUG   ] Got command RPT from MCS: ref #285211
2018-10-27 07:18:53 [DEBUG   ] summary = ERROR
2018-10-27 07:18:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285211  13 58418 26333433 A  ERRORERROR'
2018-10-27 07:18:53 [DEBUG   ] Got command RPT from MCS: ref #285212
2018-10-27 07:18:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:18:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285212  77 58418 26333637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:18:53 [DEBUG   ] Got command RPT from MCS: ref #285213
2018-10-27 07:18:53 [DEBUG   ] summary = ERROR
2018-10-27 07:18:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285213  13 58418 26333841 A  ERRORERROR'
2018-10-27 07:18:54 [DEBUG   ] Got command RPT from MCS: ref #285214
2018-10-27 07:18:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:18:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285214  77 58418 26334045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:18:54 [DEBUG   ] Got command RPT from MCS: ref #285215
2018-10-27 07:18:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 07:18:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285215  12 58418 26334237 A  ERRORB–™š'
2018-10-27 07:18:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 07:19:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 07:19:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 07:19:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:19:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:19:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:19:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:19:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:19:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:19:41 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-10-27 07:19:57 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-27 07:20:17 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-27 07:20:37 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 07:20:37 [DEBUG   ] Got command RPT from MCS: ref #285220
2018-10-27 07:20:37 [DEBUG   ] summary = ERROR
2018-10-27 07:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285220  13 58418 26437653 A  ERRORERROR'
2018-10-27 07:20:37 [DEBUG   ] Got command RPT from MCS: ref #285221
2018-10-27 07:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285221  77 58418 26437654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:20:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:20:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 07:20:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:20:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:20:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:20:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:20:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:20:42 [DEBUG   ] Finished updating board flags in 2.542 seconds
2018-10-27 07:20:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 07:21:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 07:21:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 07:21:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:21:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:21:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:21:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:21:41 [WARNING ] (13, 1, 'bot')
2018-10-27 07:21:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:21:41 [DEBUG   ] Finished updating board flags in 1.312 seconds
2018-10-27 07:21:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 07:22:17 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 07:22:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 07:22:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:22:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:22:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:22:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:22:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:22:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:22:42 [DEBUG   ] Finished updating board flags in 2.162 seconds
2018-10-27 07:22:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 07:23:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 07:23:37 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-10-27 07:23:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:23:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 07:23:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:23:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:23:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:23:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:23:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:23:42 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-10-27 07:23:53 [DEBUG   ] Got command RPT from MCS: ref #285243
2018-10-27 07:23:53 [DEBUG   ] summary = ERROR
2018-10-27 07:23:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285243  13 58418 26633525 A  ERRORERROR'
2018-10-27 07:23:53 [DEBUG   ] Got command RPT from MCS: ref #285244
2018-10-27 07:23:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:23:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285244  77 58418 26633717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:23:53 [DEBUG   ] Got command RPT from MCS: ref #285245
2018-10-27 07:23:53 [DEBUG   ] summary = ERROR
2018-10-27 07:23:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285245  13 58418 26633921 A  ERRORERROR'
2018-10-27 07:23:54 [DEBUG   ] Got command RPT from MCS: ref #285247
2018-10-27 07:23:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:23:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285247  77 58418 26634125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:23:54 [DEBUG   ] Got command RPT from MCS: ref #285248
2018-10-27 07:23:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 07:23:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285248  12 58418 26634329 A  ERRORB—™š'
2018-10-27 07:23:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 07:24:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 07:24:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 07:24:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:24:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:24:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:24:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:24:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:24:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:24:42 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-27 07:24:57 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-10-27 07:25:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 07:25:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 07:25:37 [DEBUG   ] Got command RPT from MCS: ref #285253
2018-10-27 07:25:37 [DEBUG   ] summary = ERROR
2018-10-27 07:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285253  13 58418 26737653 A  ERRORERROR'
2018-10-27 07:25:37 [DEBUG   ] Got command RPT from MCS: ref #285254
2018-10-27 07:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285254  77 58418 26737654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:25:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:25:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:25:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:25:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:25:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:25:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:25:42 [DEBUG   ] Finished updating board flags in 1.879 seconds
2018-10-27 07:25:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 07:26:17 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-27 07:26:37 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-27 07:26:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:26:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:26:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:26:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:26:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:26:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:26:42 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-10-27 07:26:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 07:27:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 07:27:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 07:27:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:27:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:27:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:27:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:27:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:27:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:27:42 [DEBUG   ] Finished updating board flags in 1.692 seconds
2018-10-27 07:27:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 07:28:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 07:28:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 07:28:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:28:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:28:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:28:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:28:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:28:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:28:42 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-27 07:28:53 [DEBUG   ] Got command RPT from MCS: ref #285274
2018-10-27 07:28:53 [DEBUG   ] summary = ERROR
2018-10-27 07:28:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285274  13 58418 26933605 A  ERRORERROR'
2018-10-27 07:28:53 [DEBUG   ] Got command RPT from MCS: ref #285275
2018-10-27 07:28:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:28:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285275  77 58418 26933809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:28:54 [DEBUG   ] Got command RPT from MCS: ref #285276
2018-10-27 07:28:54 [DEBUG   ] summary = ERROR
2018-10-27 07:28:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285276  13 58418 26934013 A  ERRORERROR'
2018-10-27 07:28:54 [DEBUG   ] Got command RPT from MCS: ref #285277
2018-10-27 07:28:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:28:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285277  77 58418 26934205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:28:54 [DEBUG   ] Got command RPT from MCS: ref #285278
2018-10-27 07:28:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 07:28:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285278  12 58418 26934409 A  ERRORB–™š'
2018-10-27 07:28:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 07:29:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 07:29:38 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 07:29:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:29:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 07:29:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:29:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:29:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:29:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:29:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:29:42 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-10-27 07:29:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 07:30:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 07:30:37 [DEBUG   ] Got command RPT from MCS: ref #285283
2018-10-27 07:30:37 [DEBUG   ] summary = ERROR
2018-10-27 07:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285283  13 58418 27037661 A  ERRORERROR'
2018-10-27 07:30:37 [DEBUG   ] Got command RPT from MCS: ref #285284
2018-10-27 07:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285284  77 58418 27037662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:30:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 07:30:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:30:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:30:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:30:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:30:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:30:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:30:42 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-10-27 07:30:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 07:31:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 07:31:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 07:31:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:31:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:31:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:31:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:31:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:31:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:31:42 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-10-27 07:31:59 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-10-27 07:32:19 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-27 07:32:39 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-27 07:32:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:32:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:32:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:32:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:32:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:32:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:32:42 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-27 07:32:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 07:33:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 07:33:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 07:33:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:33:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:33:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:33:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:33:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:33:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:33:42 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-27 07:33:53 [DEBUG   ] Got command RPT from MCS: ref #285306
2018-10-27 07:33:53 [DEBUG   ] summary = ERROR
2018-10-27 07:33:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285306  13 58418 27233689 A  ERRORERROR'
2018-10-27 07:33:53 [DEBUG   ] Got command RPT from MCS: ref #285307
2018-10-27 07:33:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:33:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285307  77 58418 27233893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:33:54 [DEBUG   ] Got command RPT from MCS: ref #285308
2018-10-27 07:33:54 [DEBUG   ] summary = ERROR
2018-10-27 07:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285308  13 58418 27234097 A  ERRORERROR'
2018-10-27 07:33:54 [DEBUG   ] Got command RPT from MCS: ref #285310
2018-10-27 07:33:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285310  77 58418 27234289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:33:54 [DEBUG   ] Got command RPT from MCS: ref #285312
2018-10-27 07:33:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 07:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285312  12 58418 27234493 A  ERRORB•™š'
2018-10-27 07:33:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 07:34:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 07:34:39 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-10-27 07:34:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:34:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:34:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:34:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:34:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:34:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:34:42 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-10-27 07:34:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 07:35:19 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-27 07:35:37 [DEBUG   ] Got command RPT from MCS: ref #285320
2018-10-27 07:35:37 [DEBUG   ] summary = ERROR
2018-10-27 07:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285320  13 58418 27337661 A  ERRORERROR'
2018-10-27 07:35:37 [DEBUG   ] Got command RPT from MCS: ref #285321
2018-10-27 07:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285321  77 58418 27337662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:35:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 07:35:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:35:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:35:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:35:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:35:42 [WARNING ] (13, 1, 'bot')
2018-10-27 07:35:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:35:42 [DEBUG   ] Finished updating board flags in 1.347 seconds
2018-10-27 07:35:59 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 07:36:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 07:36:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 07:36:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:36:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:36:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:36:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:36:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:36:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:36:43 [DEBUG   ] Finished updating board flags in 2.065 seconds
2018-10-27 07:36:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 07:37:19 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 07:37:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 07:37:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:37:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:37:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:37:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:37:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:37:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:37:43 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-27 07:37:59 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-27 07:38:20 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-27 07:38:39 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-10-27 07:38:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 07:38:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:38:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:38:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:38:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:38:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:38:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:38:43 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-10-27 07:38:53 [DEBUG   ] Got command RPT from MCS: ref #285341
2018-10-27 07:38:53 [DEBUG   ] summary = ERROR
2018-10-27 07:38:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285341  13 58418 27533769 A  ERRORERROR'
2018-10-27 07:38:53 [DEBUG   ] Got command RPT from MCS: ref #285342
2018-10-27 07:38:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:38:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285342  77 58418 27533973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:38:54 [DEBUG   ] Got command RPT from MCS: ref #285343
2018-10-27 07:38:54 [DEBUG   ] summary = ERROR
2018-10-27 07:38:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285343  13 58418 27534177 A  ERRORERROR'
2018-10-27 07:38:54 [DEBUG   ] Got command RPT from MCS: ref #285344
2018-10-27 07:38:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:38:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285344  77 58418 27534381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:38:54 [DEBUG   ] Got command RPT from MCS: ref #285345
2018-10-27 07:38:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 07:38:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285345  12 58418 27534573 A  ERRORB–™š'
2018-10-27 07:39:00 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2018-10-27 07:39:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 07:39:40 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 07:39:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:39:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:39:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:39:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:39:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:39:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:39:43 [DEBUG   ] Finished updating board flags in 1.802 seconds
2018-10-27 07:40:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 07:40:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 07:40:37 [DEBUG   ] Got command RPT from MCS: ref #285346
2018-10-27 07:40:37 [DEBUG   ] summary = ERROR
2018-10-27 07:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285346  13 58418 27637665 A  ERRORERROR'
2018-10-27 07:40:37 [DEBUG   ] Got command RPT from MCS: ref #285347
2018-10-27 07:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285347  77 58418 27637666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:40:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 07:40:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:40:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:40:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:40:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:40:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:40:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:40:43 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-10-27 07:41:00 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 07:41:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 07:41:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 07:41:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:41:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:41:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:41:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:41:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:41:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:41:43 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-10-27 07:42:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 07:42:20 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 07:42:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 07:42:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:42:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:42:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:42:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:42:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:42:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:42:43 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-10-27 07:43:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 07:43:21 [DEBUG   ] Finished updating ant stats in 1.405 seconds
2018-10-27 07:43:40 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-27 07:43:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 07:43:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:43:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:43:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:43:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:43:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:43:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:43:43 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-10-27 07:43:53 [DEBUG   ] Got command RPT from MCS: ref #285369
2018-10-27 07:43:53 [DEBUG   ] summary = ERROR
2018-10-27 07:43:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285369  13 58418 27833865 A  ERRORERROR'
2018-10-27 07:43:54 [DEBUG   ] Got command RPT from MCS: ref #285370
2018-10-27 07:43:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285370  77 58418 27834057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:43:54 [DEBUG   ] Got command RPT from MCS: ref #285371
2018-10-27 07:43:54 [DEBUG   ] summary = ERROR
2018-10-27 07:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285371  13 58418 27834261 A  ERRORERROR'
2018-10-27 07:43:54 [DEBUG   ] Got command RPT from MCS: ref #285373
2018-10-27 07:43:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285373  77 58418 27834465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:43:54 [DEBUG   ] Got command RPT from MCS: ref #285374
2018-10-27 07:43:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 07:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285374  12 58418 27834669 A  ERRORB—™š'
2018-10-27 07:44:01 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-27 07:44:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 07:44:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 07:44:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:44:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:44:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:44:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:44:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:44:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:44:43 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-27 07:45:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 07:45:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 07:45:37 [DEBUG   ] Got command RPT from MCS: ref #285383
2018-10-27 07:45:37 [DEBUG   ] summary = ERROR
2018-10-27 07:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285383  13 58418 27937661 A  ERRORERROR'
2018-10-27 07:45:37 [DEBUG   ] Got command RPT from MCS: ref #285384
2018-10-27 07:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285384  77 58418 27937662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:45:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 07:45:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:45:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 07:45:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:45:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:45:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:45:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:45:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:45:43 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-10-27 07:46:01 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-10-27 07:46:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 07:46:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 07:46:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:46:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:46:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:46:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:46:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:46:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:46:43 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-27 07:47:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 07:47:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 07:47:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 07:47:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:47:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:47:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:47:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:47:43 [WARNING ] (13, 1, 'bot')
2018-10-27 07:47:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:47:43 [DEBUG   ] Finished updating board flags in 1.339 seconds
2018-10-27 07:48:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 07:48:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 07:48:42 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-27 07:48:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:48:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:48:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:48:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:48:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:48:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:48:44 [DEBUG   ] Finished updating board flags in 2.074 seconds
2018-10-27 07:48:53 [DEBUG   ] Got command RPT from MCS: ref #285404
2018-10-27 07:48:53 [DEBUG   ] summary = ERROR
2018-10-27 07:48:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285404  13 58418 28133949 A  ERRORERROR'
2018-10-27 07:48:54 [DEBUG   ] Got command RPT from MCS: ref #285405
2018-10-27 07:48:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:48:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285405  77 58418 28134153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:48:54 [DEBUG   ] Got command RPT from MCS: ref #285406
2018-10-27 07:48:54 [DEBUG   ] summary = ERROR
2018-10-27 07:48:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285406  13 58418 28134345 A  ERRORERROR'
2018-10-27 07:48:54 [DEBUG   ] Got command RPT from MCS: ref #285407
2018-10-27 07:48:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:48:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285407  77 58418 28134549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:48:54 [DEBUG   ] Got command RPT from MCS: ref #285408
2018-10-27 07:48:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 07:48:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285408  12 58418 28134753 A  ERRORB–™š'
2018-10-27 07:49:02 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-27 07:49:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 07:49:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 07:49:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:49:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:49:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:49:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:49:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:49:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:49:44 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-27 07:50:02 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-27 07:50:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 07:50:37 [DEBUG   ] Got command RPT from MCS: ref #285413
2018-10-27 07:50:37 [DEBUG   ] summary = ERROR
2018-10-27 07:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285413  13 58418 28237661 A  ERRORERROR'
2018-10-27 07:50:37 [DEBUG   ] Got command RPT from MCS: ref #285414
2018-10-27 07:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285414  77 58418 28237662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:50:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 07:50:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:50:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:50:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:50:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:50:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:50:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:50:44 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-10-27 07:51:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 07:51:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-27 07:51:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 07:51:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:51:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:51:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:51:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:51:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:51:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:51:44 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-27 07:52:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 07:52:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 07:52:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 07:52:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:52:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:52:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:52:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:52:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:52:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:52:44 [DEBUG   ] Finished updating board flags in 1.854 seconds
2018-10-27 07:53:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 07:53:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 07:53:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 07:53:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:53:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:53:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:53:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:53:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:53:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:53:44 [DEBUG   ] Finished updating board flags in 1.732 seconds
2018-10-27 07:53:54 [DEBUG   ] Got command RPT from MCS: ref #285436
2018-10-27 07:53:54 [DEBUG   ] summary = ERROR
2018-10-27 07:53:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285436  13 58418 28434029 A  ERRORERROR'
2018-10-27 07:53:54 [DEBUG   ] Got command RPT from MCS: ref #285437
2018-10-27 07:53:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:53:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285437  77 58418 28434233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:53:54 [DEBUG   ] Got command RPT from MCS: ref #285438
2018-10-27 07:53:54 [DEBUG   ] summary = ERROR
2018-10-27 07:53:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285438  13 58418 28434437 A  ERRORERROR'
2018-10-27 07:53:54 [DEBUG   ] Got command RPT from MCS: ref #285440
2018-10-27 07:53:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:53:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285440  77 58418 28434641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:53:54 [DEBUG   ] Got command RPT from MCS: ref #285441
2018-10-27 07:53:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 07:53:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285441  12 58418 28434833 A  ERRORB•™š'
2018-10-27 07:54:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 07:54:23 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-27 07:54:42 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 07:54:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:54:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:54:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:54:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:54:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:54:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:54:44 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-10-27 07:55:03 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 07:55:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 07:55:37 [DEBUG   ] Got command RPT from MCS: ref #285446
2018-10-27 07:55:37 [DEBUG   ] summary = ERROR
2018-10-27 07:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285446  13 58418 28537665 A  ERRORERROR'
2018-10-27 07:55:37 [DEBUG   ] Got command RPT from MCS: ref #285447
2018-10-27 07:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285447  77 58418 28537666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:55:43 [DEBUG   ] Finished updating ant stats in 1.253 seconds
2018-10-27 07:55:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:55:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:55:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:55:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:55:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:55:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:55:44 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-10-27 07:56:03 [DEBUG   ] Finished updating ant stats in 1.152 seconds
2018-10-27 07:56:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-27 07:56:43 [DEBUG   ] Finished updating ant stats in 0.853 seconds
2018-10-27 07:56:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:56:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:56:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:56:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:56:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:56:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:56:44 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-10-27 07:57:03 [DEBUG   ] Finished updating ant stats in 0.752 seconds
2018-10-27 07:57:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 07:57:43 [DEBUG   ] Finished updating ant stats in 0.449 seconds
2018-10-27 07:57:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:57:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:57:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:57:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:57:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:57:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:57:44 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-10-27 07:58:04 [DEBUG   ] Finished updating ant stats in 1.357 seconds
2018-10-27 07:58:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 07:58:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:58:44 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2018-10-27 07:58:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:58:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:58:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:58:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:58:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:58:44 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-10-27 07:58:54 [DEBUG   ] Got command RPT from MCS: ref #285467
2018-10-27 07:58:54 [DEBUG   ] summary = ERROR
2018-10-27 07:58:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285467  13 58418 28734125 A  ERRORERROR'
2018-10-27 07:58:54 [DEBUG   ] Got command RPT from MCS: ref #285468
2018-10-27 07:58:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:58:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285468  77 58418 28734317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:58:54 [DEBUG   ] Got command RPT from MCS: ref #285469
2018-10-27 07:58:54 [DEBUG   ] summary = ERROR
2018-10-27 07:58:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285469  13 58418 28734521 A  ERRORERROR'
2018-10-27 07:58:54 [DEBUG   ] Got command RPT from MCS: ref #285470
2018-10-27 07:58:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 07:58:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285470  77 58418 28734725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 07:58:54 [DEBUG   ] Got command RPT from MCS: ref #285471
2018-10-27 07:58:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 07:58:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285471  12 58418 28734929 A  ERRORB•™š'
2018-10-27 07:59:04 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2018-10-27 07:59:24 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 07:59:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 07:59:44 [DEBUG   ] Finished updating ant stats in 0.843 seconds
2018-10-27 07:59:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:59:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:59:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:59:44 [WARNING ] (13, 1, 'bot')
2018-10-27 07:59:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 07:59:44 [DEBUG   ] Finished updating board flags in 1.480 seconds
2018-10-27 08:00:04 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2018-10-27 08:00:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 08:00:37 [DEBUG   ] Got command RPT from MCS: ref #285476
2018-10-27 08:00:37 [DEBUG   ] summary = ERROR
2018-10-27 08:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285476  13 58418 28837661 A  ERRORERROR'
2018-10-27 08:00:37 [DEBUG   ] Got command RPT from MCS: ref #285477
2018-10-27 08:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285477  77 58418 28837662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:00:44 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 08:00:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:00:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:00:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:00:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:00:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:00:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:00:45 [DEBUG   ] Finished updating board flags in 2.253 seconds
2018-10-27 08:01:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 08:01:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 08:01:44 [DEBUG   ] Finished updating ant stats in 0.452 seconds
2018-10-27 08:01:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:01:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:01:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:01:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:01:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:01:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:01:45 [DEBUG   ] Finished updating board flags in 2.184 seconds
2018-10-27 08:02:05 [DEBUG   ] Finished updating ant stats in 1.356 seconds
2018-10-27 08:02:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 08:02:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:02:45 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2018-10-27 08:02:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:02:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:02:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:02:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:02:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:02:45 [DEBUG   ] Finished updating board flags in 2.083 seconds
2018-10-27 08:03:05 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2018-10-27 08:03:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 08:03:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:03:45 [DEBUG   ] Finished updating ant stats in 0.842 seconds
2018-10-27 08:03:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:03:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:03:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:03:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:03:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:03:45 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-10-27 08:03:54 [DEBUG   ] Got command RPT from MCS: ref #285499
2018-10-27 08:03:54 [DEBUG   ] summary = ERROR
2018-10-27 08:03:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285499  13 58418 29034205 A  ERRORERROR'
2018-10-27 08:03:54 [DEBUG   ] Got command RPT from MCS: ref #285500
2018-10-27 08:03:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:03:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285500  77 58418 29034409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:03:54 [DEBUG   ] Got command RPT from MCS: ref #285501
2018-10-27 08:03:54 [DEBUG   ] summary = ERROR
2018-10-27 08:03:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285501  13 58418 29034601 A  ERRORERROR'
2018-10-27 08:03:54 [DEBUG   ] Got command RPT from MCS: ref #285503
2018-10-27 08:03:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:03:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285503  77 58418 29034805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:03:55 [DEBUG   ] Got command RPT from MCS: ref #285504
2018-10-27 08:03:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 08:03:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285504  12 58418 29035009 A  ERRORB–™š'
2018-10-27 08:04:05 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2018-10-27 08:04:25 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-10-27 08:04:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:04:45 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2018-10-27 08:04:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:04:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:04:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:04:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:04:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:04:45 [DEBUG   ] Finished updating board flags in 1.998 seconds
2018-10-27 08:05:05 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-10-27 08:05:26 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 08:05:37 [DEBUG   ] Got command RPT from MCS: ref #285513
2018-10-27 08:05:37 [DEBUG   ] summary = ERROR
2018-10-27 08:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285513  13 58418 29137661 A  ERRORERROR'
2018-10-27 08:05:37 [DEBUG   ] Got command RPT from MCS: ref #285514
2018-10-27 08:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285514  77 58418 29137662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:05:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:05:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 08:05:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 08:05:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:05:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:05:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:05:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:05:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:05:46 [DEBUG   ] Finished updating board flags in 2.894 seconds
2018-10-27 08:06:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 08:06:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 08:06:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:06:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:06:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:06:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:06:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:06:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:06:45 [DEBUG   ] Finished updating board flags in 1.671 seconds
2018-10-27 08:06:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 08:07:06 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-27 08:07:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 08:07:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:07:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:07:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:07:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:07:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:07:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:07:45 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-10-27 08:07:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 08:08:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 08:08:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-27 08:08:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:08:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:08:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:08:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:08:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:08:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:08:45 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-27 08:08:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 08:08:54 [DEBUG   ] Got command RPT from MCS: ref #285534
2018-10-27 08:08:54 [DEBUG   ] summary = ERROR
2018-10-27 08:08:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285534  13 58418 29334297 A  ERRORERROR'
2018-10-27 08:08:54 [DEBUG   ] Got command RPT from MCS: ref #285535
2018-10-27 08:08:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:08:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285535  77 58418 29334489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:08:54 [DEBUG   ] Got command RPT from MCS: ref #285536
2018-10-27 08:08:54 [DEBUG   ] summary = ERROR
2018-10-27 08:08:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285536  13 58418 29334693 A  ERRORERROR'
2018-10-27 08:08:54 [DEBUG   ] Got command RPT from MCS: ref #285537
2018-10-27 08:08:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:08:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285537  77 58418 29334897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:08:55 [DEBUG   ] Got command RPT from MCS: ref #285538
2018-10-27 08:08:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 08:08:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285538  12 58418 29335089 A  ERRORB–™š'
2018-10-27 08:09:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 08:09:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 08:09:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:09:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:09:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:09:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:09:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:09:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:09:45 [DEBUG   ] Finished updating board flags in 1.585 seconds
2018-10-27 08:09:46 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-10-27 08:10:06 [DEBUG   ] Finished updating ant stats in 0.592 seconds
2018-10-27 08:10:26 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 08:10:37 [DEBUG   ] Got command RPT from MCS: ref #285539
2018-10-27 08:10:37 [DEBUG   ] summary = ERROR
2018-10-27 08:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285539  13 58418 29437661 A  ERRORERROR'
2018-10-27 08:10:37 [DEBUG   ] Got command RPT from MCS: ref #285540
2018-10-27 08:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285540  77 58418 29437662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:10:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:10:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:10:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:10:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:10:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:10:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:10:45 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-10-27 08:10:47 [DEBUG   ] Finished updating ant stats in 1.388 seconds
2018-10-27 08:11:07 [DEBUG   ] Finished updating ant stats in 1.212 seconds
2018-10-27 08:11:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 08:11:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:11:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 08:11:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:11:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:11:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:11:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:11:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:11:45 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-10-27 08:11:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 08:12:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 08:12:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 08:12:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:12:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:12:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:12:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:12:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:12:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:12:45 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-10-27 08:12:47 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 08:13:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 08:13:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 08:13:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:13:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:13:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:13:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:13:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:13:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:13:45 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-10-27 08:13:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 08:13:54 [DEBUG   ] Got command RPT from MCS: ref #285562
2018-10-27 08:13:54 [DEBUG   ] summary = ERROR
2018-10-27 08:13:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285562  13 58418 29634377 A  ERRORERROR'
2018-10-27 08:13:54 [DEBUG   ] Got command RPT from MCS: ref #285563
2018-10-27 08:13:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:13:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285563  77 58418 29634581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:13:54 [DEBUG   ] Got command RPT from MCS: ref #285564
2018-10-27 08:13:54 [DEBUG   ] summary = ERROR
2018-10-27 08:13:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285564  13 58418 29634773 A  ERRORERROR'
2018-10-27 08:13:54 [DEBUG   ] Got command RPT from MCS: ref #285566
2018-10-27 08:13:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:13:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285566  77 58418 29634977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:13:55 [DEBUG   ] Got command RPT from MCS: ref #285568
2018-10-27 08:13:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 08:13:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285568  12 58418 29635181 A  ERRORB•™š'
2018-10-27 08:14:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 08:14:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 08:14:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:14:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:14:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:14:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:14:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:14:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:14:45 [DEBUG   ] Finished updating board flags in 1.442 seconds
2018-10-27 08:14:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 08:15:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 08:15:27 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 08:15:37 [DEBUG   ] Got command RPT from MCS: ref #285576
2018-10-27 08:15:37 [DEBUG   ] summary = ERROR
2018-10-27 08:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285576  13 58418 29737669 A  ERRORERROR'
2018-10-27 08:15:37 [DEBUG   ] Got command RPT from MCS: ref #285577
2018-10-27 08:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285577  77 58418 29737670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:15:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:15:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:15:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:15:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:15:45 [WARNING ] (13, 1, 'bot')
2018-10-27 08:15:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:15:45 [DEBUG   ] Finished updating board flags in 1.454 seconds
2018-10-27 08:15:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 08:16:08 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-27 08:16:28 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 08:16:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:16:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:16:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:16:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:16:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:16:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:16:46 [DEBUG   ] Finished updating board flags in 2.233 seconds
2018-10-27 08:16:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 08:17:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 08:17:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 08:17:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:17:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:17:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:17:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:17:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:17:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:17:46 [DEBUG   ] Finished updating board flags in 2.154 seconds
2018-10-27 08:17:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 08:18:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 08:18:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 08:18:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:18:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:18:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:18:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:18:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:18:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:18:46 [DEBUG   ] Finished updating board flags in 2.029 seconds
2018-10-27 08:18:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 08:18:54 [DEBUG   ] Got command RPT from MCS: ref #285597
2018-10-27 08:18:54 [DEBUG   ] summary = ERROR
2018-10-27 08:18:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285597  13 58418 29934465 A  ERRORERROR'
2018-10-27 08:18:54 [DEBUG   ] Got command RPT from MCS: ref #285598
2018-10-27 08:18:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:18:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285598  77 58418 29934657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:18:54 [DEBUG   ] Got command RPT from MCS: ref #285599
2018-10-27 08:18:54 [DEBUG   ] summary = ERROR
2018-10-27 08:18:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285599  13 58418 29934861 A  ERRORERROR'
2018-10-27 08:18:55 [DEBUG   ] Got command RPT from MCS: ref #285600
2018-10-27 08:18:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:18:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285600  77 58418 29935065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:18:55 [DEBUG   ] Got command RPT from MCS: ref #285601
2018-10-27 08:18:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 08:18:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285601  12 58418 29935269 A  ERRORB•™š'
2018-10-27 08:19:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 08:19:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 08:19:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:19:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 08:19:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:19:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:19:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:19:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:19:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:19:46 [DEBUG   ] Finished updating board flags in 2.020 seconds
2018-10-27 08:19:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 08:20:08 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 08:20:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 08:20:37 [DEBUG   ] Got command RPT from MCS: ref #285606
2018-10-27 08:20:37 [DEBUG   ] summary = ERROR
2018-10-27 08:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285606  13 58418 30037665 A  ERRORERROR'
2018-10-27 08:20:37 [DEBUG   ] Got command RPT from MCS: ref #285607
2018-10-27 08:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285607  77 58418 30037666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:20:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:20:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:20:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:20:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:20:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:20:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:20:46 [DEBUG   ] Finished updating board flags in 1.960 seconds
2018-10-27 08:20:49 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-27 08:21:09 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 08:21:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 08:21:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:21:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:21:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:21:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:21:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:21:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:21:46 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-27 08:21:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 08:22:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 08:22:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 08:22:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:22:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 08:22:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:22:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:22:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:22:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:22:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:22:46 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-27 08:22:49 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 08:23:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 08:23:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 08:23:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 08:23:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:23:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:23:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:23:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:23:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:23:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:23:46 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-27 08:23:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 08:23:54 [DEBUG   ] Got command RPT from MCS: ref #285629
2018-10-27 08:23:54 [DEBUG   ] summary = ERROR
2018-10-27 08:23:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285629  13 58418 30234541 A  ERRORERROR'
2018-10-27 08:23:54 [DEBUG   ] Got command RPT from MCS: ref #285630
2018-10-27 08:23:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:23:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285630  77 58418 30234745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:23:54 [DEBUG   ] Got command RPT from MCS: ref #285631
2018-10-27 08:23:54 [DEBUG   ] summary = ERROR
2018-10-27 08:23:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285631  13 58418 30234949 A  ERRORERROR'
2018-10-27 08:23:55 [DEBUG   ] Got command RPT from MCS: ref #285633
2018-10-27 08:23:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:23:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285633  77 58418 30235153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:23:55 [DEBUG   ] Got command RPT from MCS: ref #285634
2018-10-27 08:23:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 08:23:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285634  12 58418 30235345 A  ERRORB—™š'
2018-10-27 08:24:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 08:24:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 08:24:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:24:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:24:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:24:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:24:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:24:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:24:46 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-10-27 08:24:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 08:25:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 08:25:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 08:25:37 [DEBUG   ] Got command RPT from MCS: ref #285639
2018-10-27 08:25:37 [DEBUG   ] summary = ERROR
2018-10-27 08:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285639  13 58418 30337669 A  ERRORERROR'
2018-10-27 08:25:37 [DEBUG   ] Got command RPT from MCS: ref #285640
2018-10-27 08:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285640  77 58418 30337670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:25:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:25:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:25:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:25:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:25:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:25:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:25:46 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-10-27 08:25:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 08:26:10 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-27 08:26:29 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 08:26:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:26:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:26:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:26:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:26:46 [WARNING ] (13, 1, 'bot')
2018-10-27 08:26:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:26:46 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-10-27 08:26:50 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2018-10-27 08:27:10 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-27 08:27:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 08:27:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:27:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:27:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:27:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:27:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:27:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:27:47 [DEBUG   ] Finished updating board flags in 2.197 seconds
2018-10-27 08:27:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 08:28:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 08:28:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 08:28:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:28:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:28:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:28:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:28:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:28:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:28:47 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-10-27 08:28:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 08:28:54 [DEBUG   ] Got command RPT from MCS: ref #285660
2018-10-27 08:28:54 [DEBUG   ] summary = ERROR
2018-10-27 08:28:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285660  13 58418 30534629 A  ERRORERROR'
2018-10-27 08:28:54 [DEBUG   ] Got command RPT from MCS: ref #285661
2018-10-27 08:28:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:28:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285661  77 58418 30534833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:28:55 [DEBUG   ] Got command RPT from MCS: ref #285662
2018-10-27 08:28:55 [DEBUG   ] summary = ERROR
2018-10-27 08:28:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285662  13 58418 30535037 A  ERRORERROR'
2018-10-27 08:28:55 [DEBUG   ] Got command RPT from MCS: ref #285663
2018-10-27 08:28:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:28:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285663  77 58418 30535229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:28:55 [DEBUG   ] Got command RPT from MCS: ref #285664
2018-10-27 08:28:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 08:28:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285664  12 58418 30535453 A  ERRORB–™š'
2018-10-27 08:29:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 08:29:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 08:29:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:29:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:29:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:29:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:29:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:29:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:29:47 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-27 08:29:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 08:30:10 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-10-27 08:30:30 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 08:30:37 [DEBUG   ] Got command RPT from MCS: ref #285669
2018-10-27 08:30:37 [DEBUG   ] summary = ERROR
2018-10-27 08:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285669  13 58418 30637669 A  ERRORERROR'
2018-10-27 08:30:37 [DEBUG   ] Got command RPT from MCS: ref #285670
2018-10-27 08:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285670  77 58418 30637670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:30:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:30:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:30:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:30:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:30:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:30:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:30:47 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-10-27 08:30:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-27 08:31:11 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-27 08:31:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 08:31:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:31:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:31:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:31:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:31:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:31:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:31:47 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-27 08:31:50 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-27 08:32:11 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-27 08:32:31 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 08:32:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:32:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:32:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:32:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:32:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:32:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:32:47 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-10-27 08:32:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 08:33:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 08:33:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 08:33:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:33:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:33:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:33:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:33:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:33:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:33:47 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-10-27 08:33:51 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 08:33:54 [DEBUG   ] Got command RPT from MCS: ref #285692
2018-10-27 08:33:54 [DEBUG   ] summary = ERROR
2018-10-27 08:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285692  13 58418 30834717 A  ERRORERROR'
2018-10-27 08:33:54 [DEBUG   ] Got command RPT from MCS: ref #285693
2018-10-27 08:33:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285693  77 58418 30834921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:33:55 [DEBUG   ] Got command RPT from MCS: ref #285694
2018-10-27 08:33:55 [DEBUG   ] summary = ERROR
2018-10-27 08:33:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285694  13 58418 30835113 A  ERRORERROR'
2018-10-27 08:33:55 [DEBUG   ] Got command RPT from MCS: ref #285696
2018-10-27 08:33:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:33:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285696  77 58418 30835317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:33:55 [DEBUG   ] Got command RPT from MCS: ref #285697
2018-10-27 08:33:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 08:33:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285697  12 58418 30835521 A  ERRORB•™š'
2018-10-27 08:34:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 08:34:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 08:34:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:34:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 08:34:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:34:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:34:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:34:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:34:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:34:47 [DEBUG   ] Finished updating board flags in 1.402 seconds
2018-10-27 08:34:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 08:35:11 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 08:35:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 08:35:37 [DEBUG   ] Got command RPT from MCS: ref #285706
2018-10-27 08:35:37 [DEBUG   ] summary = ERROR
2018-10-27 08:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285706  13 58418 30937669 A  ERRORERROR'
2018-10-27 08:35:37 [DEBUG   ] Got command RPT from MCS: ref #285707
2018-10-27 08:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285707  77 58418 30937670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:35:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:35:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:35:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:35:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:35:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:35:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:35:47 [DEBUG   ] Finished updating board flags in 1.451 seconds
2018-10-27 08:35:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 08:36:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 08:36:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 08:36:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:36:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:36:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:36:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:36:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:36:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:36:47 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-27 08:36:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 08:37:12 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-27 08:37:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 08:37:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:37:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:37:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:37:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:37:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:37:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:37:47 [DEBUG   ] Finished updating board flags in 1.338 seconds
2018-10-27 08:37:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 08:38:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 08:38:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 08:38:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:38:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:38:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:38:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:38:47 [WARNING ] (13, 1, 'bot')
2018-10-27 08:38:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:38:47 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-10-27 08:38:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 08:38:54 [DEBUG   ] Got command RPT from MCS: ref #285727
2018-10-27 08:38:54 [DEBUG   ] summary = ERROR
2018-10-27 08:38:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285727  13 58418 31134805 A  ERRORERROR'
2018-10-27 08:38:54 [DEBUG   ] Got command RPT from MCS: ref #285728
2018-10-27 08:38:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:38:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285728  77 58418 31134997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:38:55 [DEBUG   ] Got command RPT from MCS: ref #285729
2018-10-27 08:38:55 [DEBUG   ] summary = ERROR
2018-10-27 08:38:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285729  13 58418 31135201 A  ERRORERROR'
2018-10-27 08:38:55 [DEBUG   ] Got command RPT from MCS: ref #285730
2018-10-27 08:38:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:38:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285730  77 58418 31135405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:38:55 [DEBUG   ] Got command RPT from MCS: ref #285731
2018-10-27 08:38:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 08:38:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285731  12 58418 31135609 A  ERRORB•™š'
2018-10-27 08:39:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 08:39:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 08:39:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:39:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:39:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:39:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:39:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:39:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:39:48 [DEBUG   ] Finished updating board flags in 2.062 seconds
2018-10-27 08:39:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 08:40:12 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 08:40:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 08:40:37 [DEBUG   ] Got command RPT from MCS: ref #285732
2018-10-27 08:40:37 [DEBUG   ] summary = ERROR
2018-10-27 08:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285732  13 58418 31237677 A  ERRORERROR'
2018-10-27 08:40:37 [DEBUG   ] Got command RPT from MCS: ref #285733
2018-10-27 08:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285733  77 58418 31237678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:40:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 08:40:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:40:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:40:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:40:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:40:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:40:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:40:48 [DEBUG   ] Finished updating board flags in 2.045 seconds
2018-10-27 08:40:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 08:41:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 08:41:32 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 08:41:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:41:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:41:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:41:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:41:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:41:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:41:48 [DEBUG   ] Finished updating board flags in 1.953 seconds
2018-10-27 08:41:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 08:42:12 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 08:42:32 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-27 08:42:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:42:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:42:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:42:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:42:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:42:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:42:48 [DEBUG   ] Finished updating board flags in 1.800 seconds
2018-10-27 08:42:53 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-27 08:43:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-27 08:43:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 08:43:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:43:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 08:43:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:43:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:43:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:43:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:43:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:43:48 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-10-27 08:43:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 08:43:54 [DEBUG   ] Got command RPT from MCS: ref #285755
2018-10-27 08:43:54 [DEBUG   ] summary = ERROR
2018-10-27 08:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285755  13 58418 31434885 A  ERRORERROR'
2018-10-27 08:43:55 [DEBUG   ] Got command RPT from MCS: ref #285756
2018-10-27 08:43:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:43:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285756  77 58418 31435089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:43:55 [DEBUG   ] Got command RPT from MCS: ref #285757
2018-10-27 08:43:55 [DEBUG   ] summary = ERROR
2018-10-27 08:43:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285757  13 58418 31435293 A  ERRORERROR'
2018-10-27 08:43:55 [DEBUG   ] Got command RPT from MCS: ref #285759
2018-10-27 08:43:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:43:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285759  77 58418 31435485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:43:55 [DEBUG   ] Got command RPT from MCS: ref #285760
2018-10-27 08:43:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 08:43:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285760  12 58418 31435689 A  ERRORB–™š'
2018-10-27 08:44:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 08:44:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 08:44:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:44:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:44:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:44:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:44:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:44:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:44:48 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-27 08:44:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 08:45:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 08:45:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 08:45:37 [DEBUG   ] Got command RPT from MCS: ref #285769
2018-10-27 08:45:37 [DEBUG   ] summary = ERROR
2018-10-27 08:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285769  13 58418 31537681 A  ERRORERROR'
2018-10-27 08:45:37 [DEBUG   ] Got command RPT from MCS: ref #285770
2018-10-27 08:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285770  77 58418 31537682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:45:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:45:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:45:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:45:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:45:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:45:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:45:48 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-10-27 08:45:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 08:46:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 08:46:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 08:46:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:46:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:46:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:46:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:46:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:46:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:46:48 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-10-27 08:46:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 08:47:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 08:47:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 08:47:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:47:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:47:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:47:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:47:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:47:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:47:48 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-10-27 08:47:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 08:48:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 08:48:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 08:48:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:48:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:48:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:48:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:48:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:48:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:48:48 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-27 08:48:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 08:48:54 [DEBUG   ] Got command RPT from MCS: ref #285790
2018-10-27 08:48:54 [DEBUG   ] summary = ERROR
2018-10-27 08:48:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285790  13 58418 31734977 A  ERRORERROR'
2018-10-27 08:48:55 [DEBUG   ] Got command RPT from MCS: ref #285791
2018-10-27 08:48:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:48:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285791  77 58418 31735169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:48:55 [DEBUG   ] Got command RPT from MCS: ref #285792
2018-10-27 08:48:55 [DEBUG   ] summary = ERROR
2018-10-27 08:48:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285792  13 58418 31735373 A  ERRORERROR'
2018-10-27 08:48:55 [DEBUG   ] Got command RPT from MCS: ref #285793
2018-10-27 08:48:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:48:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285793  77 58418 31735577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:48:55 [DEBUG   ] Got command RPT from MCS: ref #285794
2018-10-27 08:48:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 08:48:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285794  12 58418 31735781 A  ERRORB–™š'
2018-10-27 08:49:14 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-27 08:49:34 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-27 08:49:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:49:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:49:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:49:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:49:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:49:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:49:48 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-10-27 08:49:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 08:50:14 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 08:50:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-27 08:50:37 [DEBUG   ] Got command RPT from MCS: ref #285799
2018-10-27 08:50:37 [DEBUG   ] summary = ERROR
2018-10-27 08:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285799  13 58418 31837681 A  ERRORERROR'
2018-10-27 08:50:37 [DEBUG   ] Got command RPT from MCS: ref #285800
2018-10-27 08:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285800  77 58418 31837682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:50:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:50:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:50:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:50:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:50:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:50:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:50:48 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-10-27 08:50:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 08:51:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 08:51:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 08:51:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:51:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:51:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:51:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:51:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:51:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:51:48 [DEBUG   ] Finished updating board flags in 1.402 seconds
2018-10-27 08:51:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 08:52:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 08:52:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 08:52:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:52:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:52:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:52:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:52:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:52:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:52:48 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-10-27 08:52:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 08:53:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-27 08:53:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 08:53:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:53:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:53:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:53:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:53:48 [WARNING ] (13, 1, 'bot')
2018-10-27 08:53:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:53:48 [DEBUG   ] Finished updating board flags in 1.348 seconds
2018-10-27 08:53:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 08:53:55 [DEBUG   ] Got command RPT from MCS: ref #285822
2018-10-27 08:53:55 [DEBUG   ] summary = ERROR
2018-10-27 08:53:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285822  13 58418 32035065 A  ERRORERROR'
2018-10-27 08:53:55 [DEBUG   ] Got command RPT from MCS: ref #285823
2018-10-27 08:53:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:53:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285823  77 58418 32035257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:53:55 [DEBUG   ] Got command RPT from MCS: ref #285824
2018-10-27 08:53:55 [DEBUG   ] summary = ERROR
2018-10-27 08:53:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285824  13 58418 32035461 A  ERRORERROR'
2018-10-27 08:53:55 [DEBUG   ] Got command RPT from MCS: ref #285826
2018-10-27 08:53:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:53:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285826  77 58418 32035665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:53:55 [DEBUG   ] Got command RPT from MCS: ref #285828
2018-10-27 08:53:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 08:53:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285828  12 58418 32035857 A  ERRORB•™š'
2018-10-27 08:54:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 08:54:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-27 08:54:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:54:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:54:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:54:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:54:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:54:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:54:49 [DEBUG   ] Finished updating board flags in 2.145 seconds
2018-10-27 08:54:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 08:55:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 08:55:35 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 08:55:37 [DEBUG   ] Got command RPT from MCS: ref #285832
2018-10-27 08:55:37 [DEBUG   ] summary = ERROR
2018-10-27 08:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285832  13 58418 32137677 A  ERRORERROR'
2018-10-27 08:55:37 [DEBUG   ] Got command RPT from MCS: ref #285833
2018-10-27 08:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285833  77 58418 32137678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:55:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:55:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 08:55:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:55:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:55:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:55:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:55:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:55:49 [DEBUG   ] Finished updating board flags in 1.912 seconds
2018-10-27 08:55:55 [DEBUG   ] Finished updating ant stats in 1.211 seconds
2018-10-27 08:56:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 08:56:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 08:56:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:56:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:56:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:56:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:56:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:56:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:56:49 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-27 08:56:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 08:57:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 08:57:35 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 08:57:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:57:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:57:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:57:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:57:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:57:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:57:49 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-10-27 08:57:55 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-10-27 08:58:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 08:58:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 08:58:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:58:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:58:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:58:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:58:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:58:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:58:49 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-27 08:58:55 [DEBUG   ] Got command RPT from MCS: ref #285853
2018-10-27 08:58:55 [DEBUG   ] summary = ERROR
2018-10-27 08:58:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285853  13 58418 32335153 A  ERRORERROR'
2018-10-27 08:58:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 08:58:55 [DEBUG   ] Got command RPT from MCS: ref #285854
2018-10-27 08:58:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:58:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285854  77 58418 32335345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:58:55 [DEBUG   ] Got command RPT from MCS: ref #285855
2018-10-27 08:58:55 [DEBUG   ] summary = ERROR
2018-10-27 08:58:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285855  13 58418 32335549 A  ERRORERROR'
2018-10-27 08:58:55 [DEBUG   ] Got command RPT from MCS: ref #285856
2018-10-27 08:58:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 08:58:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285856  77 58418 32335753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 08:58:55 [DEBUG   ] Got command RPT from MCS: ref #285857
2018-10-27 08:58:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 08:58:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285857  12 58418 32335945 A  ERRORB”™š'
2018-10-27 08:59:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 08:59:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 08:59:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 08:59:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:59:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:59:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:59:49 [WARNING ] (13, 1, 'bot')
2018-10-27 08:59:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 08:59:49 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-10-27 08:59:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 09:00:15 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 09:00:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 09:00:37 [DEBUG   ] Got command RPT from MCS: ref #285862
2018-10-27 09:00:37 [DEBUG   ] summary = ERROR
2018-10-27 09:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285862  13 58418 32437686 A  ERRORERROR'
2018-10-27 09:00:37 [DEBUG   ] Got command RPT from MCS: ref #285863
2018-10-27 09:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285863  77 58418 32437686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:00:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:00:49 [WARNING ] (13, 1, 'bot')
2018-10-27 09:00:49 [WARNING ] (13, 1, 'bot')
2018-10-27 09:00:49 [WARNING ] (13, 1, 'bot')
2018-10-27 09:00:49 [WARNING ] (13, 1, 'bot')
2018-10-27 09:00:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:00:49 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-10-27 09:00:56 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-27 09:01:16 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 09:01:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 09:01:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:01:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 09:01:49 [WARNING ] (13, 1, 'bot')
2018-10-27 09:01:49 [WARNING ] (13, 1, 'bot')
2018-10-27 09:01:49 [WARNING ] (13, 1, 'bot')
2018-10-27 09:01:49 [WARNING ] (13, 1, 'bot')
2018-10-27 09:01:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:01:49 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-27 09:01:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 09:02:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 09:02:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 09:02:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:02:49 [WARNING ] (13, 1, 'bot')
2018-10-27 09:02:49 [WARNING ] (13, 1, 'bot')
2018-10-27 09:02:49 [WARNING ] (13, 1, 'bot')
2018-10-27 09:02:49 [WARNING ] (13, 1, 'bot')
2018-10-27 09:02:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:02:49 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-10-27 09:02:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 09:03:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 09:03:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 09:03:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 09:03:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:03:49 [WARNING ] (13, 1, 'bot')
2018-10-27 09:03:49 [WARNING ] (13, 1, 'bot')
2018-10-27 09:03:49 [WARNING ] (13, 1, 'bot')
2018-10-27 09:03:49 [WARNING ] (13, 1, 'bot')
2018-10-27 09:03:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:03:49 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-10-27 09:03:55 [DEBUG   ] Got command RPT from MCS: ref #285885
2018-10-27 09:03:55 [DEBUG   ] summary = ERROR
2018-10-27 09:03:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285885  13 58418 32635229 A  ERRORERROR'
2018-10-27 09:03:55 [DEBUG   ] Got command RPT from MCS: ref #285886
2018-10-27 09:03:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:03:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285886  77 58418 32635433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:03:55 [DEBUG   ] Got command RPT from MCS: ref #285887
2018-10-27 09:03:55 [DEBUG   ] summary = ERROR
2018-10-27 09:03:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285887  13 58418 32635630 A  ERRORERROR'
2018-10-27 09:03:55 [DEBUG   ] Got command RPT from MCS: ref #285889
2018-10-27 09:03:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:03:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285889  77 58418 32635833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:03:56 [DEBUG   ] Got command RPT from MCS: ref #285890
2018-10-27 09:03:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 09:03:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285890  12 58418 32636037 A  ERRORB•™š'
2018-10-27 09:03:56 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 09:04:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 09:04:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 09:04:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 09:04:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:04:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:04:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:04:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:04:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:04:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:04:50 [DEBUG   ] Finished updating board flags in 2.041 seconds
2018-10-27 09:04:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 09:05:16 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 09:05:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 09:05:37 [DEBUG   ] Got command RPT from MCS: ref #285899
2018-10-27 09:05:37 [DEBUG   ] summary = ERROR
2018-10-27 09:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285899  13 58418 32737677 A  ERRORERROR'
2018-10-27 09:05:37 [DEBUG   ] Got command RPT from MCS: ref #285900
2018-10-27 09:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285900  77 58418 32737678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:05:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:05:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:05:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:05:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:05:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:05:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:05:50 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-10-27 09:05:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 09:06:16 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 09:06:37 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 09:06:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:06:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:06:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:06:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:06:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:06:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:06:50 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-10-27 09:06:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 09:07:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 09:07:37 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 09:07:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:07:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:07:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:07:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:07:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:07:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:07:50 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-10-27 09:07:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 09:08:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 09:08:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 09:08:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:08:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 09:08:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:08:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:08:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:08:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:08:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:08:50 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-27 09:08:55 [DEBUG   ] Got command RPT from MCS: ref #285920
2018-10-27 09:08:55 [DEBUG   ] summary = ERROR
2018-10-27 09:08:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285920  13 58418 32935321 A  ERRORERROR'
2018-10-27 09:08:55 [DEBUG   ] Got command RPT from MCS: ref #285921
2018-10-27 09:08:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:08:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285921  77 58418 32935525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:08:55 [DEBUG   ] Got command RPT from MCS: ref #285922
2018-10-27 09:08:55 [DEBUG   ] summary = ERROR
2018-10-27 09:08:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285922  13 58418 32935717 A  ERRORERROR'
2018-10-27 09:08:55 [DEBUG   ] Got command RPT from MCS: ref #285923
2018-10-27 09:08:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:08:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285923  77 58418 32935921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:08:56 [DEBUG   ] Got command RPT from MCS: ref #285924
2018-10-27 09:08:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 09:08:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285924  12 58418 32936125 A  ERRORB–™š'
2018-10-27 09:08:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 09:09:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 09:09:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 09:09:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:09:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:09:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:09:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:09:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:09:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:09:50 [DEBUG   ] Finished updating board flags in 1.801 seconds
2018-10-27 09:09:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 09:10:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 09:10:37 [DEBUG   ] Got command RPT from MCS: ref #285925
2018-10-27 09:10:37 [DEBUG   ] summary = ERROR
2018-10-27 09:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285925  13 58418 33037681 A  ERRORERROR'
2018-10-27 09:10:37 [DEBUG   ] Got command RPT from MCS: ref #285926
2018-10-27 09:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285926  77 58418 33037682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:10:38 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-27 09:10:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:10:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:10:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:10:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:10:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:10:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:10:50 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-10-27 09:10:58 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-27 09:11:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 09:11:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 09:11:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:11:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:11:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:11:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:11:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:11:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:11:50 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-10-27 09:11:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 09:12:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 09:12:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 09:12:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:12:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:12:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:12:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:12:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:12:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:12:50 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-10-27 09:12:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-27 09:13:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 09:13:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 09:13:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:13:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:13:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:13:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:13:50 [WARNING ] (13, 1, 'bot')
2018-10-27 09:13:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:13:50 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-10-27 09:13:55 [DEBUG   ] Got command RPT from MCS: ref #285948
2018-10-27 09:13:55 [DEBUG   ] summary = ERROR
2018-10-27 09:13:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285948  13 58418 33235402 A  ERRORERROR'
2018-10-27 09:13:55 [DEBUG   ] Got command RPT from MCS: ref #285949
2018-10-27 09:13:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:13:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285949  77 58418 33235605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:13:55 [DEBUG   ] Got command RPT from MCS: ref #285950
2018-10-27 09:13:55 [DEBUG   ] summary = ERROR
2018-10-27 09:13:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285950  13 58418 33235809 A  ERRORERROR'
2018-10-27 09:13:56 [DEBUG   ] Got command RPT from MCS: ref #285952
2018-10-27 09:13:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:13:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285952  77 58418 33236001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:13:56 [DEBUG   ] Got command RPT from MCS: ref #285953
2018-10-27 09:13:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 09:13:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285953  12 58418 33236205 A  ERRORB•™š'
2018-10-27 09:13:58 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 09:14:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 09:14:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 09:14:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:14:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:14:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:14:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:14:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:14:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:14:51 [DEBUG   ] Finished updating board flags in 2.061 seconds
2018-10-27 09:14:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 09:15:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 09:15:37 [DEBUG   ] Got command RPT from MCS: ref #285962
2018-10-27 09:15:37 [DEBUG   ] summary = ERROR
2018-10-27 09:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285962  13 58418 33337689 A  ERRORERROR'
2018-10-27 09:15:37 [DEBUG   ] Got command RPT from MCS: ref #285963
2018-10-27 09:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285963  77 58418 33337690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:15:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-27 09:15:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:15:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:15:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:15:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:15:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:15:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:15:51 [DEBUG   ] Finished updating board flags in 2.056 seconds
2018-10-27 09:15:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 09:16:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 09:16:39 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 09:16:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:16:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:16:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:16:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:16:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:16:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:16:51 [DEBUG   ] Finished updating board flags in 1.938 seconds
2018-10-27 09:16:59 [DEBUG   ] Finished updating ant stats in 1.212 seconds
2018-10-27 09:17:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 09:17:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 09:17:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:17:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:17:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:17:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:17:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:17:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:17:51 [DEBUG   ] Finished updating board flags in 1.845 seconds
2018-10-27 09:17:59 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-27 09:18:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 09:18:39 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 09:18:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:18:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:18:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:18:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:18:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:18:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:18:51 [DEBUG   ] Finished updating board flags in 1.758 seconds
2018-10-27 09:18:55 [DEBUG   ] Got command RPT from MCS: ref #285983
2018-10-27 09:18:55 [DEBUG   ] summary = ERROR
2018-10-27 09:18:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285983  13 58418 33535489 A  ERRORERROR'
2018-10-27 09:18:55 [DEBUG   ] Got command RPT from MCS: ref #285984
2018-10-27 09:18:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:18:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285984  77 58418 33535693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:18:55 [DEBUG   ] Got command RPT from MCS: ref #285985
2018-10-27 09:18:55 [DEBUG   ] summary = ERROR
2018-10-27 09:18:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285985  13 58418 33535885 A  ERRORERROR'
2018-10-27 09:18:56 [DEBUG   ] Got command RPT from MCS: ref #285986
2018-10-27 09:18:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:18:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285986  77 58418 33536089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:18:56 [DEBUG   ] Got command RPT from MCS: ref #285987
2018-10-27 09:18:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 09:18:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285987  12 58418 33536293 A  ERRORB”™š'
2018-10-27 09:18:59 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-10-27 09:19:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 09:19:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 09:19:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:19:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:19:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:19:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:19:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:19:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:19:51 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-27 09:19:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 09:20:19 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-10-27 09:20:37 [DEBUG   ] Got command RPT from MCS: ref #285992
2018-10-27 09:20:37 [DEBUG   ] summary = ERROR
2018-10-27 09:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285992  13 58418 33637681 A  ERRORERROR'
2018-10-27 09:20:37 [DEBUG   ] Got command RPT from MCS: ref #285993
2018-10-27 09:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   285993  77 58418 33637682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:20:40 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-27 09:20:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:20:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:20:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:20:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:20:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:20:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:20:51 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-10-27 09:21:00 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 09:21:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 09:21:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 09:21:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:21:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:21:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:21:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:21:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:21:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:21:51 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-27 09:22:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 09:22:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 09:22:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 09:22:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:22:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:22:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:22:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:22:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:22:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:22:51 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-10-27 09:23:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 09:23:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 09:23:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 09:23:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:23:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 09:23:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:23:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:23:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:23:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:23:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:23:51 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-27 09:23:55 [DEBUG   ] Got command RPT from MCS: ref #286015
2018-10-27 09:23:55 [DEBUG   ] summary = ERROR
2018-10-27 09:23:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286015  13 58418 33835570 A  ERRORERROR'
2018-10-27 09:23:55 [DEBUG   ] Got command RPT from MCS: ref #286016
2018-10-27 09:23:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:23:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286016  77 58418 33835773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:23:55 [DEBUG   ] Got command RPT from MCS: ref #286017
2018-10-27 09:23:55 [DEBUG   ] summary = ERROR
2018-10-27 09:23:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286017  13 58418 33835977 A  ERRORERROR'
2018-10-27 09:23:56 [DEBUG   ] Got command RPT from MCS: ref #286019
2018-10-27 09:23:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:23:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286019  77 58418 33836181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:23:56 [DEBUG   ] Got command RPT from MCS: ref #286021
2018-10-27 09:23:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 09:23:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286021  12 58418 33836374 A  ERRORB–™š'
2018-10-27 09:24:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 09:24:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 09:24:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 09:24:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-10-27 09:24:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:24:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:24:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:24:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:24:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:24:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:24:51 [DEBUG   ] Finished updating board flags in 1.461 seconds
2018-10-27 09:25:00 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 09:25:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 09:25:37 [DEBUG   ] Got command RPT from MCS: ref #286025
2018-10-27 09:25:37 [DEBUG   ] summary = ERROR
2018-10-27 09:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286025  13 58418 33937681 A  ERRORERROR'
2018-10-27 09:25:37 [DEBUG   ] Got command RPT from MCS: ref #286026
2018-10-27 09:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286026  77 58418 33937682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:25:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 09:25:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:25:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:25:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:25:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:25:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:25:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:25:51 [DEBUG   ] Finished updating board flags in 1.469 seconds
2018-10-27 09:26:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 09:26:20 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 09:26:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 09:26:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:26:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 09:26:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:26:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:26:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:26:51 [WARNING ] (13, 1, 'bot')
2018-10-27 09:26:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:26:51 [DEBUG   ] Finished updating board flags in 1.508 seconds
2018-10-27 09:27:01 [DEBUG   ] Finished updating ant stats in 1.405 seconds
2018-10-27 09:27:21 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-27 09:27:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 09:27:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:27:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:27:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:27:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:27:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:27:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:27:52 [DEBUG   ] Finished updating board flags in 2.226 seconds
2018-10-27 09:28:01 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-27 09:28:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 09:28:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 09:28:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:28:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:28:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:28:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:28:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:28:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:28:52 [DEBUG   ] Finished updating board flags in 2.119 seconds
2018-10-27 09:28:55 [DEBUG   ] Got command RPT from MCS: ref #286046
2018-10-27 09:28:55 [DEBUG   ] summary = ERROR
2018-10-27 09:28:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286046  13 58418 34135661 A  ERRORERROR'
2018-10-27 09:28:55 [DEBUG   ] Got command RPT from MCS: ref #286047
2018-10-27 09:28:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:28:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286047  77 58418 34135865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:28:56 [DEBUG   ] Got command RPT from MCS: ref #286048
2018-10-27 09:28:56 [DEBUG   ] summary = ERROR
2018-10-27 09:28:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286048  13 58418 34136057 A  ERRORERROR'
2018-10-27 09:28:56 [DEBUG   ] Got command RPT from MCS: ref #286049
2018-10-27 09:28:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:28:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286049  77 58418 34136261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:28:56 [DEBUG   ] Got command RPT from MCS: ref #286050
2018-10-27 09:28:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 09:28:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286050  12 58418 34136465 A  ERRORB–™š'
2018-10-27 09:29:01 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 09:29:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 09:29:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 09:29:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:29:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:29:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:29:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:29:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:29:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:29:52 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-27 09:30:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 09:30:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 09:30:37 [DEBUG   ] Got command RPT from MCS: ref #286055
2018-10-27 09:30:37 [DEBUG   ] summary = ERROR
2018-10-27 09:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286055  13 58418 34237685 A  ERRORERROR'
2018-10-27 09:30:37 [DEBUG   ] Got command RPT from MCS: ref #286056
2018-10-27 09:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286056  77 58418 34237686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:30:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 09:30:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:30:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:30:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:30:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:30:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:30:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:30:52 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-10-27 09:31:01 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-10-27 09:31:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 09:31:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 09:31:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:31:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:31:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:31:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:31:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:31:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:31:52 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-10-27 09:32:02 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-27 09:32:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 09:32:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-27 09:32:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:32:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:32:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:32:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:32:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:32:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:32:52 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-27 09:33:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 09:33:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 09:33:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 09:33:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:33:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:33:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:33:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:33:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:33:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:33:52 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-27 09:33:55 [DEBUG   ] Got command RPT from MCS: ref #286078
2018-10-27 09:33:55 [DEBUG   ] summary = ERROR
2018-10-27 09:33:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286078  13 58418 34435749 A  ERRORERROR'
2018-10-27 09:33:55 [DEBUG   ] Got command RPT from MCS: ref #286079
2018-10-27 09:33:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:33:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286079  77 58418 34435941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:33:56 [DEBUG   ] Got command RPT from MCS: ref #286080
2018-10-27 09:33:56 [DEBUG   ] summary = ERROR
2018-10-27 09:33:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286080  13 58418 34436145 A  ERRORERROR'
2018-10-27 09:33:56 [DEBUG   ] Got command RPT from MCS: ref #286082
2018-10-27 09:33:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:33:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286082  77 58418 34436349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:33:56 [DEBUG   ] Got command RPT from MCS: ref #286083
2018-10-27 09:33:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 09:33:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286083  12 58418 34436553 A  ERRORB•™š'
2018-10-27 09:34:02 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-27 09:34:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 09:34:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 09:34:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:34:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:34:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:34:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:34:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:34:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:34:52 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-27 09:35:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 09:35:22 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-27 09:35:37 [DEBUG   ] Got command RPT from MCS: ref #286092
2018-10-27 09:35:37 [DEBUG   ] summary = ERROR
2018-10-27 09:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286092  13 58418 34537686 A  ERRORERROR'
2018-10-27 09:35:37 [DEBUG   ] Got command RPT from MCS: ref #286093
2018-10-27 09:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286093  77 58418 34537686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:35:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 09:35:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:35:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:35:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:35:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:35:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:35:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:35:52 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-10-27 09:36:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 09:36:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 09:36:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 09:36:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:36:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:36:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:36:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:36:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:36:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:36:52 [DEBUG   ] Finished updating board flags in 1.652 seconds
2018-10-27 09:37:03 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-27 09:37:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 09:37:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 09:37:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:37:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:37:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:37:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:37:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:37:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:37:52 [DEBUG   ] Finished updating board flags in 1.533 seconds
2018-10-27 09:38:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 09:38:23 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 09:38:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 09:38:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 09:38:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:38:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 09:38:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:38:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:38:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:38:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:38:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:38:52 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-10-27 09:38:55 [DEBUG   ] Got command RPT from MCS: ref #286113
2018-10-27 09:38:55 [DEBUG   ] summary = ERROR
2018-10-27 09:38:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286113  13 58418 34735829 A  ERRORERROR'
2018-10-27 09:38:56 [DEBUG   ] Got command RPT from MCS: ref #286114
2018-10-27 09:38:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:38:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286114  77 58418 34736033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:38:56 [DEBUG   ] Got command RPT from MCS: ref #286115
2018-10-27 09:38:56 [DEBUG   ] summary = ERROR
2018-10-27 09:38:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286115  13 58418 34736237 A  ERRORERROR'
2018-10-27 09:38:56 [DEBUG   ] Got command RPT from MCS: ref #286116
2018-10-27 09:38:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:38:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286116  77 58418 34736429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:38:56 [DEBUG   ] Got command RPT from MCS: ref #286117
2018-10-27 09:38:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 09:38:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286117  12 58418 34736633 A  ERRORB–™š'
2018-10-27 09:39:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 09:39:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 09:39:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 09:39:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:39:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 09:39:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:39:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:39:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:39:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:39:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:39:52 [DEBUG   ] Finished updating board flags in 1.444 seconds
2018-10-27 09:40:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 09:40:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 09:40:37 [DEBUG   ] Got command RPT from MCS: ref #286118
2018-10-27 09:40:37 [DEBUG   ] summary = ERROR
2018-10-27 09:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286118  13 58418 34837685 A  ERRORERROR'
2018-10-27 09:40:37 [DEBUG   ] Got command RPT from MCS: ref #286119
2018-10-27 09:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286119  77 58418 34837686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:40:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 09:40:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:40:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 09:40:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:40:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:40:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:40:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:40:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:40:52 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-10-27 09:41:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 09:41:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 09:41:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 09:41:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:41:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 09:41:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:41:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:41:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:41:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:41:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:41:52 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-10-27 09:42:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 09:42:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 09:42:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 09:42:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:42:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:42:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:42:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:42:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:42:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:42:52 [DEBUG   ] Finished updating board flags in 1.454 seconds
2018-10-27 09:43:04 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-27 09:43:24 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-27 09:43:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 09:43:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:43:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 09:43:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:43:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:43:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:43:52 [WARNING ] (13, 1, 'bot')
2018-10-27 09:43:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:43:52 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-10-27 09:43:55 [DEBUG   ] Got command RPT from MCS: ref #286141
2018-10-27 09:43:55 [DEBUG   ] summary = ERROR
2018-10-27 09:43:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286141  13 58418 35035913 A  ERRORERROR'
2018-10-27 09:43:56 [DEBUG   ] Got command RPT from MCS: ref #286142
2018-10-27 09:43:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:43:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286142  77 58418 35036117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:43:56 [DEBUG   ] Got command RPT from MCS: ref #286143
2018-10-27 09:43:56 [DEBUG   ] summary = ERROR
2018-10-27 09:43:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286143  13 58418 35036321 A  ERRORERROR'
2018-10-27 09:43:56 [DEBUG   ] Got command RPT from MCS: ref #286145
2018-10-27 09:43:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:43:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286145  77 58418 35036513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:43:56 [DEBUG   ] Got command RPT from MCS: ref #286146
2018-10-27 09:43:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 09:43:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286146  12 58418 35036717 A  ERRORB–™š'
2018-10-27 09:44:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 09:44:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 09:44:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 09:44:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:44:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 09:44:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:44:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:44:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:44:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:44:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:44:53 [DEBUG   ] Finished updating board flags in 2.192 seconds
2018-10-27 09:45:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 09:45:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 09:45:37 [DEBUG   ] Got command RPT from MCS: ref #286155
2018-10-27 09:45:37 [DEBUG   ] summary = ERROR
2018-10-27 09:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286155  13 58418 35137689 A  ERRORERROR'
2018-10-27 09:45:37 [DEBUG   ] Got command RPT from MCS: ref #286156
2018-10-27 09:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286156  77 58418 35137690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:45:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 09:45:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:45:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:45:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:45:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:45:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:45:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:45:53 [DEBUG   ] Finished updating board flags in 1.973 seconds
2018-10-27 09:46:04 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 09:46:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 09:46:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 09:46:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:46:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:46:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:46:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:46:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:46:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:46:53 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-27 09:47:04 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 09:47:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 09:47:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 09:47:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:47:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:47:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:47:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:47:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:47:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:47:53 [DEBUG   ] Finished updating board flags in 1.765 seconds
2018-10-27 09:48:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 09:48:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 09:48:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 09:48:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:48:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:48:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:48:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:48:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:48:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:48:53 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-27 09:48:56 [DEBUG   ] Got command RPT from MCS: ref #286176
2018-10-27 09:48:56 [DEBUG   ] summary = ERROR
2018-10-27 09:48:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286176  13 58418 35336005 A  ERRORERROR'
2018-10-27 09:48:56 [DEBUG   ] Got command RPT from MCS: ref #286177
2018-10-27 09:48:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:48:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286177  77 58418 35336197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:48:56 [DEBUG   ] Got command RPT from MCS: ref #286178
2018-10-27 09:48:56 [DEBUG   ] summary = ERROR
2018-10-27 09:48:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286178  13 58418 35336401 A  ERRORERROR'
2018-10-27 09:48:56 [DEBUG   ] Got command RPT from MCS: ref #286179
2018-10-27 09:48:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:48:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286179  77 58418 35336605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:48:56 [DEBUG   ] Got command RPT from MCS: ref #286180
2018-10-27 09:48:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 09:48:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286180  12 58418 35336797 A  ERRORB•™š'
2018-10-27 09:49:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 09:49:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 09:49:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 09:49:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:49:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:49:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:49:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:49:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:49:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:49:53 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-10-27 09:50:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 09:50:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 09:50:37 [DEBUG   ] Got command RPT from MCS: ref #286185
2018-10-27 09:50:37 [DEBUG   ] summary = ERROR
2018-10-27 09:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286185  13 58418 35437689 A  ERRORERROR'
2018-10-27 09:50:37 [DEBUG   ] Got command RPT from MCS: ref #286186
2018-10-27 09:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286186  77 58418 35437690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:50:45 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-27 09:50:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:50:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:50:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:50:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:50:53 [WARNING ] (13, 1, 'bot')
2018-10-27 09:50:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:50:53 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-10-27 09:51:05 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-27 09:51:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 09:51:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 09:51:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:51:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:51:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:51:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:51:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:51:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:51:54 [DEBUG   ] Finished updating board flags in 2.196 seconds
2018-10-27 09:52:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 09:52:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 09:52:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 09:52:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:52:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:52:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:52:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:52:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:52:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:52:54 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-10-27 09:53:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 09:53:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 09:53:45 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 09:53:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:53:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:53:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:53:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:53:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:53:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:53:54 [DEBUG   ] Finished updating board flags in 1.962 seconds
2018-10-27 09:53:56 [DEBUG   ] Got command RPT from MCS: ref #286208
2018-10-27 09:53:56 [DEBUG   ] summary = ERROR
2018-10-27 09:53:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286208  13 58418 35636089 A  ERRORERROR'
2018-10-27 09:53:56 [DEBUG   ] Got command RPT from MCS: ref #286209
2018-10-27 09:53:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:53:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286209  77 58418 35636281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:53:56 [DEBUG   ] Got command RPT from MCS: ref #286210
2018-10-27 09:53:56 [DEBUG   ] summary = ERROR
2018-10-27 09:53:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286210  13 58418 35636485 A  ERRORERROR'
2018-10-27 09:53:56 [DEBUG   ] Got command RPT from MCS: ref #286212
2018-10-27 09:53:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:53:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286212  77 58418 35636689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:53:56 [DEBUG   ] Got command RPT from MCS: ref #286214
2018-10-27 09:53:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 09:53:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286214  12 58418 35636881 A  ERRORB•™š'
2018-10-27 09:54:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 09:54:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 09:54:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 09:54:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:54:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:54:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:54:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:54:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:54:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:54:54 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-27 09:55:05 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-27 09:55:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 09:55:37 [DEBUG   ] Got command RPT from MCS: ref #286218
2018-10-27 09:55:37 [DEBUG   ] summary = ERROR
2018-10-27 09:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286218  13 58418 35737693 A  ERRORERROR'
2018-10-27 09:55:37 [DEBUG   ] Got command RPT from MCS: ref #286219
2018-10-27 09:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286219  77 58418 35737694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:55:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 09:55:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:55:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 09:55:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:55:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:55:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:55:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:55:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:55:54 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-10-27 09:56:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 09:56:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 09:56:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 09:56:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 09:56:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:56:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:56:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:56:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:56:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:56:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:56:54 [DEBUG   ] Finished updating board flags in 1.648 seconds
2018-10-27 09:57:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 09:57:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 09:57:46 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-27 09:57:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:57:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:57:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:57:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:57:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:57:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:57:54 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-10-27 09:58:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-27 09:58:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 09:58:46 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 09:58:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 09:58:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:58:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:58:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:58:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:58:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:58:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:58:54 [DEBUG   ] Finished updating board flags in 1.556 seconds
2018-10-27 09:58:56 [DEBUG   ] Got command RPT from MCS: ref #286239
2018-10-27 09:58:56 [DEBUG   ] summary = ERROR
2018-10-27 09:58:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286239  13 58418 35936169 A  ERRORERROR'
2018-10-27 09:58:56 [DEBUG   ] Got command RPT from MCS: ref #286240
2018-10-27 09:58:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:58:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286240  77 58418 35936373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:58:56 [DEBUG   ] Got command RPT from MCS: ref #286241
2018-10-27 09:58:56 [DEBUG   ] summary = ERROR
2018-10-27 09:58:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286241  13 58418 35936565 A  ERRORERROR'
2018-10-27 09:58:56 [DEBUG   ] Got command RPT from MCS: ref #286242
2018-10-27 09:58:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 09:58:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286242  77 58418 35936769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 09:58:56 [DEBUG   ] Got command RPT from MCS: ref #286243
2018-10-27 09:58:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 09:58:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286243  12 58418 35936973 A  ERRORB—™š'
2018-10-27 09:59:06 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-27 09:59:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 09:59:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 09:59:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 09:59:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 09:59:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:59:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:59:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:59:54 [WARNING ] (13, 1, 'bot')
2018-10-27 09:59:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 09:59:54 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-27 10:00:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 10:00:26 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-27 10:00:37 [DEBUG   ] Got command RPT from MCS: ref #286248
2018-10-27 10:00:37 [DEBUG   ] summary = ERROR
2018-10-27 10:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286248  13 58418 36037693 A  ERRORERROR'
2018-10-27 10:00:37 [DEBUG   ] Got command RPT from MCS: ref #286249
2018-10-27 10:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286249  77 58418 36037694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:00:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 10:00:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:00:54 [WARNING ] (13, 1, 'bot')
2018-10-27 10:00:54 [WARNING ] (13, 1, 'bot')
2018-10-27 10:00:54 [WARNING ] (13, 1, 'bot')
2018-10-27 10:00:54 [WARNING ] (13, 1, 'bot')
2018-10-27 10:00:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:00:54 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-10-27 10:01:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 10:01:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 10:01:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 10:01:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:01:54 [WARNING ] (13, 1, 'bot')
2018-10-27 10:01:54 [WARNING ] (13, 1, 'bot')
2018-10-27 10:01:54 [WARNING ] (13, 1, 'bot')
2018-10-27 10:01:54 [WARNING ] (13, 1, 'bot')
2018-10-27 10:01:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:01:54 [DEBUG   ] Finished updating board flags in 1.475 seconds
2018-10-27 10:02:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 10:02:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 10:02:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 10:02:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:02:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 10:02:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:02:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:02:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:02:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:02:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:02:55 [DEBUG   ] Finished updating board flags in 2.203 seconds
2018-10-27 10:03:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 10:03:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 10:03:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 10:03:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:03:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:03:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:03:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:03:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:03:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:03:55 [DEBUG   ] Finished updating board flags in 2.131 seconds
2018-10-27 10:03:56 [DEBUG   ] Got command RPT from MCS: ref #286271
2018-10-27 10:03:56 [DEBUG   ] summary = ERROR
2018-10-27 10:03:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286271  13 58418 36236249 A  ERRORERROR'
2018-10-27 10:03:56 [DEBUG   ] Got command RPT from MCS: ref #286272
2018-10-27 10:03:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:03:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286272  77 58418 36236453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:03:56 [DEBUG   ] Got command RPT from MCS: ref #286273
2018-10-27 10:03:56 [DEBUG   ] summary = ERROR
2018-10-27 10:03:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286273  13 58418 36236657 A  ERRORERROR'
2018-10-27 10:03:56 [DEBUG   ] Got command RPT from MCS: ref #286275
2018-10-27 10:03:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:03:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286275  77 58418 36236861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:03:57 [DEBUG   ] Got command RPT from MCS: ref #286276
2018-10-27 10:03:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 10:03:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286276  12 58418 36237053 A  ERRORB–™š'
2018-10-27 10:04:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 10:04:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-27 10:04:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 10:04:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:04:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:04:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:04:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:04:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:04:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:04:55 [DEBUG   ] Finished updating board flags in 2.036 seconds
2018-10-27 10:05:07 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-27 10:05:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 10:05:37 [DEBUG   ] Got command RPT from MCS: ref #286285
2018-10-27 10:05:37 [DEBUG   ] summary = ERROR
2018-10-27 10:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286285  13 58418 36337693 A  ERRORERROR'
2018-10-27 10:05:37 [DEBUG   ] Got command RPT from MCS: ref #286286
2018-10-27 10:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286286  77 58418 36337694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:05:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 10:05:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:05:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:05:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:05:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:05:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:05:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:05:55 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-10-27 10:06:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 10:06:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-27 10:06:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 10:06:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:06:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:06:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:06:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:06:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:06:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:06:55 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-27 10:07:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 10:07:27 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-27 10:07:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 10:07:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:07:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:07:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:07:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:07:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:07:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:07:55 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-10-27 10:08:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 10:08:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 10:08:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 10:08:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:08:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:08:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:08:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:08:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:08:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:08:55 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-10-27 10:08:56 [DEBUG   ] Got command RPT from MCS: ref #286306
2018-10-27 10:08:56 [DEBUG   ] summary = ERROR
2018-10-27 10:08:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286306  13 58418 36536337 A  ERRORERROR'
2018-10-27 10:08:56 [DEBUG   ] Got command RPT from MCS: ref #286307
2018-10-27 10:08:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:08:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286307  77 58418 36536541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:08:56 [DEBUG   ] Got command RPT from MCS: ref #286308
2018-10-27 10:08:56 [DEBUG   ] summary = ERROR
2018-10-27 10:08:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286308  13 58418 36536745 A  ERRORERROR'
2018-10-27 10:08:56 [DEBUG   ] Got command RPT from MCS: ref #286309
2018-10-27 10:08:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:08:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286309  77 58418 36536949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:08:57 [DEBUG   ] Got command RPT from MCS: ref #286310
2018-10-27 10:08:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 10:08:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286310  12 58418 36537141 A  ERRORB•™š'
2018-10-27 10:09:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-27 10:09:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 10:09:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 10:09:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:09:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:09:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:09:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:09:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:09:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:09:55 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-10-27 10:10:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 10:10:27 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-10-27 10:10:37 [DEBUG   ] Got command RPT from MCS: ref #286311
2018-10-27 10:10:37 [DEBUG   ] summary = ERROR
2018-10-27 10:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286311  13 58418 36637693 A  ERRORERROR'
2018-10-27 10:10:37 [DEBUG   ] Got command RPT from MCS: ref #286312
2018-10-27 10:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286312  77 58418 36637694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:10:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 10:10:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:10:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:10:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:10:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:10:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:10:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:10:55 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-27 10:11:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 10:11:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-27 10:11:48 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-27 10:11:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:11:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:11:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:11:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:11:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:11:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:11:55 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-10-27 10:12:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 10:12:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 10:12:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 10:12:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:12:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 10:12:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:12:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:12:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:12:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:12:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:12:55 [DEBUG   ] Finished updating board flags in 1.395 seconds
2018-10-27 10:13:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 10:13:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 10:13:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 10:13:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:13:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:13:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:13:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:13:55 [WARNING ] (13, 1, 'bot')
2018-10-27 10:13:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:13:55 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-10-27 10:13:56 [DEBUG   ] Got command RPT from MCS: ref #286334
2018-10-27 10:13:56 [DEBUG   ] summary = ERROR
2018-10-27 10:13:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286334  13 58418 36836421 A  ERRORERROR'
2018-10-27 10:13:56 [DEBUG   ] Got command RPT from MCS: ref #286335
2018-10-27 10:13:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:13:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286335  77 58418 36836625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:13:56 [DEBUG   ] Got command RPT from MCS: ref #286336
2018-10-27 10:13:56 [DEBUG   ] summary = ERROR
2018-10-27 10:13:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286336  13 58418 36836829 A  ERRORERROR'
2018-10-27 10:13:57 [DEBUG   ] Got command RPT from MCS: ref #286338
2018-10-27 10:13:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:13:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286338  77 58418 36837021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:13:57 [DEBUG   ] Got command RPT from MCS: ref #286340
2018-10-27 10:13:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 10:13:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286340  12 58418 36837225 A  ERRORB”™š'
2018-10-27 10:14:08 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-27 10:14:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 10:14:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 10:14:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:14:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:14:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:14:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:14:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:14:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:14:56 [DEBUG   ] Finished updating board flags in 2.064 seconds
2018-10-27 10:15:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 10:15:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 10:15:37 [DEBUG   ] Got command RPT from MCS: ref #286348
2018-10-27 10:15:37 [DEBUG   ] summary = ERROR
2018-10-27 10:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286348  13 58418 36937701 A  ERRORERROR'
2018-10-27 10:15:37 [DEBUG   ] Got command RPT from MCS: ref #286349
2018-10-27 10:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286349  77 58418 36937702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:15:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 10:15:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:15:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:15:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:15:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:15:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:15:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:15:56 [DEBUG   ] Finished updating board flags in 2.099 seconds
2018-10-27 10:16:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 10:16:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 10:16:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 10:16:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:16:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 10:16:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:16:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:16:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:16:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:16:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:16:56 [DEBUG   ] Finished updating board flags in 1.887 seconds
2018-10-27 10:17:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 10:17:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 10:17:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 10:17:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:17:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:17:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:17:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:17:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:17:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:17:56 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-10-27 10:18:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 10:18:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 10:18:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 10:18:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:18:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 10:18:56 [DEBUG   ] Got command RPT from MCS: ref #286369
2018-10-27 10:18:56 [DEBUG   ] summary = ERROR
2018-10-27 10:18:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286369  13 58418 37136514 A  ERRORERROR'
2018-10-27 10:18:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:18:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:18:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:18:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:18:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:18:56 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-10-27 10:18:56 [DEBUG   ] Got command RPT from MCS: ref #286370
2018-10-27 10:18:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:18:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286370  77 58418 37136705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:18:56 [DEBUG   ] Got command RPT from MCS: ref #286371
2018-10-27 10:18:56 [DEBUG   ] summary = ERROR
2018-10-27 10:18:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286371  13 58418 37136909 A  ERRORERROR'
2018-10-27 10:18:57 [DEBUG   ] Got command RPT from MCS: ref #286372
2018-10-27 10:18:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286372  77 58418 37137113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:18:57 [DEBUG   ] Got command RPT from MCS: ref #286373
2018-10-27 10:18:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 10:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286373  12 58418 37137317 A  ERRORB–™š'
2018-10-27 10:19:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 10:19:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 10:19:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 10:19:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:19:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:19:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:19:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:19:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:19:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:19:56 [DEBUG   ] Finished updating board flags in 1.763 seconds
2018-10-27 10:20:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 10:20:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 10:20:37 [DEBUG   ] Got command RPT from MCS: ref #286378
2018-10-27 10:20:37 [DEBUG   ] summary = ERROR
2018-10-27 10:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286378  13 58418 37237693 A  ERRORERROR'
2018-10-27 10:20:37 [DEBUG   ] Got command RPT from MCS: ref #286379
2018-10-27 10:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286379  77 58418 37237694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:20:48 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-27 10:20:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:20:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 10:20:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:20:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:20:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:20:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:20:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:20:56 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-10-27 10:21:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 10:21:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 10:21:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 10:21:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:21:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 10:21:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:21:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:21:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:21:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:21:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:21:56 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-27 10:22:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 10:22:29 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-27 10:22:49 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-27 10:22:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:22:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:22:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:22:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:22:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:22:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:22:56 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-10-27 10:23:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 10:23:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 10:23:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 10:23:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:23:56 [DEBUG   ] Got command RPT from MCS: ref #286401
2018-10-27 10:23:56 [DEBUG   ] summary = ERROR
2018-10-27 10:23:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286401  13 58418 37436597 A  ERRORERROR'
2018-10-27 10:23:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:23:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:23:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:23:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:23:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:23:56 [DEBUG   ] Finished updating board flags in 1.462 seconds
2018-10-27 10:23:56 [DEBUG   ] Got command RPT from MCS: ref #286402
2018-10-27 10:23:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:23:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286402  77 58418 37436789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:23:56 [DEBUG   ] Got command RPT from MCS: ref #286403
2018-10-27 10:23:56 [DEBUG   ] summary = ERROR
2018-10-27 10:23:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286403  13 58418 37436993 A  ERRORERROR'
2018-10-27 10:23:57 [DEBUG   ] Got command RPT from MCS: ref #286404
2018-10-27 10:23:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:23:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286404  77 58418 37437197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:23:57 [DEBUG   ] Got command RPT from MCS: ref #286406
2018-10-27 10:23:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 10:23:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286406  12 58418 37437401 A  ERRORB–™š'
2018-10-27 10:24:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 10:24:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 10:24:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 10:24:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:24:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:24:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:24:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:24:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:24:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:24:56 [DEBUG   ] Finished updating board flags in 1.459 seconds
2018-10-27 10:25:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-27 10:25:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 10:25:37 [DEBUG   ] Got command RPT from MCS: ref #286411
2018-10-27 10:25:37 [DEBUG   ] summary = ERROR
2018-10-27 10:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286411  13 58418 37537697 A  ERRORERROR'
2018-10-27 10:25:37 [DEBUG   ] Got command RPT from MCS: ref #286412
2018-10-27 10:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286412  77 58418 37537698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:25:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 10:25:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:25:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:25:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:25:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:25:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:25:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:25:56 [DEBUG   ] Finished updating board flags in 1.456 seconds
2018-10-27 10:26:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 10:26:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 10:26:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 10:26:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:26:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 10:26:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:26:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:26:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:26:56 [WARNING ] (13, 1, 'bot')
2018-10-27 10:26:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:26:56 [DEBUG   ] Finished updating board flags in 1.461 seconds
2018-10-27 10:27:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 10:27:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 10:27:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 10:27:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:27:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:27:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:27:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:27:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:27:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:27:57 [DEBUG   ] Finished updating board flags in 2.294 seconds
2018-10-27 10:28:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 10:28:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 10:28:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 10:28:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:28:56 [DEBUG   ] Got command RPT from MCS: ref #286432
2018-10-27 10:28:56 [DEBUG   ] summary = ERROR
2018-10-27 10:28:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286432  13 58418 37736681 A  ERRORERROR'
2018-10-27 10:28:56 [DEBUG   ] Got command RPT from MCS: ref #286433
2018-10-27 10:28:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:28:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286433  77 58418 37736873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:28:57 [DEBUG   ] Got command RPT from MCS: ref #286434
2018-10-27 10:28:57 [DEBUG   ] summary = ERROR
2018-10-27 10:28:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286434  13 58418 37737081 A  ERRORERROR'
2018-10-27 10:28:57 [DEBUG   ] Got command RPT from MCS: ref #286435
2018-10-27 10:28:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:28:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286435  77 58418 37737277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:28:57 [DEBUG   ] Got command RPT from MCS: ref #286436
2018-10-27 10:28:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 10:28:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286436  12 58418 37737485 A  ERRORB•™š'
2018-10-27 10:28:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:28:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:28:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:28:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:28:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:28:57 [DEBUG   ] Finished updating board flags in 2.080 seconds
2018-10-27 10:29:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 10:29:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 10:29:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 10:29:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:29:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:29:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:29:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:29:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:29:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:29:57 [DEBUG   ] Finished updating board flags in 2.024 seconds
2018-10-27 10:30:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 10:30:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 10:30:37 [DEBUG   ] Got command RPT from MCS: ref #286441
2018-10-27 10:30:37 [DEBUG   ] summary = ERROR
2018-10-27 10:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286441  13 58418 37837693 A  ERRORERROR'
2018-10-27 10:30:37 [DEBUG   ] Got command RPT from MCS: ref #286442
2018-10-27 10:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286442  77 58418 37837694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:30:49 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-27 10:30:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:30:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:30:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:30:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:30:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:30:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:30:57 [DEBUG   ] Finished updating board flags in 1.977 seconds
2018-10-27 10:31:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 10:31:30 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-27 10:31:50 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 10:31:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:31:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-10-27 10:31:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:31:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:31:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:31:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:31:57 [WARNING ] (25, 5, 'bot')
2018-10-27 10:31:57 [WARNING ] (25, 5, 'bot')
2018-10-27 10:31:57 [WARNING ] (25, 5, 'bot')
2018-10-27 10:31:57 [WARNING ] (25, 5, 'bot')
2018-10-27 10:31:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:31:57 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-10-27 10:32:10 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-27 10:32:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 10:32:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 10:32:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:32:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:32:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:32:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:32:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:32:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:32:57 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-10-27 10:33:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 10:33:30 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-27 10:33:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 10:33:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:33:56 [DEBUG   ] Got command RPT from MCS: ref #286464
2018-10-27 10:33:56 [DEBUG   ] summary = ERROR
2018-10-27 10:33:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286464  13 58418 38036761 A  ERRORERROR'
2018-10-27 10:33:56 [DEBUG   ] Got command RPT from MCS: ref #286465
2018-10-27 10:33:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:33:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286465  77 58418 38036965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:33:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 10:33:57 [DEBUG   ] Got command RPT from MCS: ref #286466
2018-10-27 10:33:57 [DEBUG   ] summary = ERROR
2018-10-27 10:33:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286466  13 58418 38037157 A  ERRORERROR'
2018-10-27 10:33:57 [DEBUG   ] Got command RPT from MCS: ref #286467
2018-10-27 10:33:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:33:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286467  77 58418 38037361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:33:57 [DEBUG   ] Got command RPT from MCS: ref #286469
2018-10-27 10:33:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 10:33:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286469  12 58418 38037565 A  ERRORB—™š'
2018-10-27 10:33:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:33:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:33:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:33:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:33:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:33:57 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-27 10:34:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 10:34:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 10:34:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-27 10:34:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:34:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 10:34:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:34:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:34:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:34:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:34:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:34:57 [DEBUG   ] Finished updating board flags in 1.585 seconds
2018-10-27 10:35:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 10:35:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 10:35:37 [DEBUG   ] Got command RPT from MCS: ref #286478
2018-10-27 10:35:37 [DEBUG   ] summary = ERROR
2018-10-27 10:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286478  13 58418 38137701 A  ERRORERROR'
2018-10-27 10:35:37 [DEBUG   ] Got command RPT from MCS: ref #286479
2018-10-27 10:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286479  77 58418 38137702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:35:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 10:35:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:35:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:35:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:35:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:35:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:35:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:35:57 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-27 10:36:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-27 10:36:31 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-27 10:36:51 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-10-27 10:36:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:36:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:36:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:36:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:36:57 [WARNING ] (13, 1, 'bot')
2018-10-27 10:36:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:36:57 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-10-27 10:37:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 10:37:31 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-27 10:37:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 10:37:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:37:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:37:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:37:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:37:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:37:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:37:58 [DEBUG   ] Finished updating board flags in 2.208 seconds
2018-10-27 10:38:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 10:38:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 10:38:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 10:38:56 [DEBUG   ] Got command RPT from MCS: ref #286499
2018-10-27 10:38:56 [DEBUG   ] summary = ERROR
2018-10-27 10:38:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286499  13 58418 38336849 A  ERRORERROR'
2018-10-27 10:38:57 [DEBUG   ] Got command RPT from MCS: ref #286500
2018-10-27 10:38:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:38:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286500  77 58418 38337041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:38:57 [DEBUG   ] Got command RPT from MCS: ref #286501
2018-10-27 10:38:57 [DEBUG   ] summary = ERROR
2018-10-27 10:38:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286501  13 58418 38337249 A  ERRORERROR'
2018-10-27 10:38:57 [DEBUG   ] Got command RPT from MCS: ref #286502
2018-10-27 10:38:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:38:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286502  77 58418 38337457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:38:57 [DEBUG   ] Got command RPT from MCS: ref #286503
2018-10-27 10:38:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 10:38:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286503  12 58418 38337649 A  ERRORBŒÌÍ'
2018-10-27 10:38:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:38:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:38:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:38:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:38:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:38:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:38:58 [DEBUG   ] Finished updating board flags in 2.177 seconds
2018-10-27 10:39:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 10:39:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 10:39:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 10:39:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:39:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:39:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:39:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:39:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:39:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:39:58 [DEBUG   ] Finished updating board flags in 2.131 seconds
2018-10-27 10:40:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 10:40:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 10:40:37 [DEBUG   ] Got command RPT from MCS: ref #286504
2018-10-27 10:40:37 [DEBUG   ] summary = ERROR
2018-10-27 10:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286504  13 58418 38437705 A  ERRORERROR'
2018-10-27 10:40:37 [DEBUG   ] Got command RPT from MCS: ref #286505
2018-10-27 10:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286505  77 58418 38437706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:40:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 10:40:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:40:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:40:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:40:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:40:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:40:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:40:58 [DEBUG   ] Finished updating board flags in 1.886 seconds
2018-10-27 10:41:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 10:41:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 10:41:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 10:41:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:41:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 10:41:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:41:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:41:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:41:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:41:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:41:58 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-27 10:42:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 10:42:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 10:42:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 10:42:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:42:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-10-27 10:42:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:42:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:42:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:42:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:42:58 [WARNING ] (25, 5, 'bot')
2018-10-27 10:42:58 [WARNING ] (25, 5, 'bot')
2018-10-27 10:42:58 [WARNING ] (25, 5, 'bot')
2018-10-27 10:42:58 [WARNING ] (25, 5, 'bot')
2018-10-27 10:42:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:42:58 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-10-27 10:43:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 10:43:31 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-27 10:43:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 10:43:56 [DEBUG   ] Got command RPT from MCS: ref #286527
2018-10-27 10:43:56 [DEBUG   ] summary = ERROR
2018-10-27 10:43:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286527  13 58418 38636933 A  ERRORERROR'
2018-10-27 10:43:57 [DEBUG   ] Got command RPT from MCS: ref #286528
2018-10-27 10:43:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:43:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286528  77 58418 38637125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:43:57 [DEBUG   ] Got command RPT from MCS: ref #286529
2018-10-27 10:43:57 [DEBUG   ] summary = ERROR
2018-10-27 10:43:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286529  13 58418 38637329 A  ERRORERROR'
2018-10-27 10:43:57 [DEBUG   ] Got command RPT from MCS: ref #286530
2018-10-27 10:43:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:43:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286530  77 58418 38637533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:43:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:43:57 [DEBUG   ] Got command RPT from MCS: ref #286532
2018-10-27 10:43:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 10:43:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286532  12 58418 38637741 A  ERRORBŠÌÍ'
2018-10-27 10:43:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:43:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:43:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:43:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:43:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:43:58 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-10-27 10:44:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 10:44:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 10:44:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 10:44:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:44:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 10:44:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:44:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:44:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:44:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:44:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:44:58 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-10-27 10:45:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 10:45:32 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-27 10:45:37 [DEBUG   ] Got command RPT from MCS: ref #286541
2018-10-27 10:45:37 [DEBUG   ] summary = ERROR
2018-10-27 10:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286541  13 58418 38737697 A  ERRORERROR'
2018-10-27 10:45:37 [DEBUG   ] Got command RPT from MCS: ref #286542
2018-10-27 10:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286542  77 58418 38737698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:45:51 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-27 10:45:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:45:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 10:45:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:45:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:45:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:45:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:45:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:45:58 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-27 10:46:12 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-10-27 10:46:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 10:46:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 10:46:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:46:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 10:46:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:46:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:46:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:46:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:46:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:46:58 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-10-27 10:47:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 10:47:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 10:47:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 10:47:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:47:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:47:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:47:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:47:58 [WARNING ] (13, 1, 'bot')
2018-10-27 10:47:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:47:58 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-10-27 10:48:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 10:48:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 10:48:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 10:48:57 [DEBUG   ] Got command RPT from MCS: ref #286562
2018-10-27 10:48:57 [DEBUG   ] summary = ERROR
2018-10-27 10:48:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286562  13 58418 38937013 A  ERRORERROR'
2018-10-27 10:48:57 [DEBUG   ] Got command RPT from MCS: ref #286563
2018-10-27 10:48:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:48:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286563  77 58418 38937217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:48:57 [DEBUG   ] Got command RPT from MCS: ref #286564
2018-10-27 10:48:57 [DEBUG   ] summary = ERROR
2018-10-27 10:48:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286564  13 58418 38937421 A  ERRORERROR'
2018-10-27 10:48:57 [DEBUG   ] Got command RPT from MCS: ref #286565
2018-10-27 10:48:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:48:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286565  77 58418 38937614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:48:57 [DEBUG   ] Got command RPT from MCS: ref #286566
2018-10-27 10:48:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 10:48:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286566  12 58418 38937817 A  ERRORB•™š'
2018-10-27 10:48:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:48:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:48:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:48:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:48:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:48:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:48:59 [DEBUG   ] Finished updating board flags in 2.075 seconds
2018-10-27 10:49:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 10:49:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 10:49:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 10:49:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:49:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:49:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:49:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:49:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:49:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:49:59 [DEBUG   ] Finished updating board flags in 2.066 seconds
2018-10-27 10:50:12 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-10-27 10:50:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 10:50:37 [DEBUG   ] Got command RPT from MCS: ref #286571
2018-10-27 10:50:37 [DEBUG   ] summary = ERROR
2018-10-27 10:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286571  13 58418 39037697 A  ERRORERROR'
2018-10-27 10:50:37 [DEBUG   ] Got command RPT from MCS: ref #286572
2018-10-27 10:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286572  77 58418 39037698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:50:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 10:50:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:50:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:50:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:50:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:50:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:50:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:50:59 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-27 10:51:12 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-27 10:51:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 10:51:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 10:51:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:51:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:51:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:51:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:51:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:51:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:51:59 [DEBUG   ] Finished updating board flags in 1.904 seconds
2018-10-27 10:52:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 10:52:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 10:52:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 10:52:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:52:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:52:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:52:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:52:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:52:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:52:59 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-10-27 10:53:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 10:53:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 10:53:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 10:53:57 [DEBUG   ] Got command RPT from MCS: ref #286594
2018-10-27 10:53:57 [DEBUG   ] summary = ERROR
2018-10-27 10:53:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286594  13 58418 39237101 A  ERRORERROR'
2018-10-27 10:53:57 [DEBUG   ] Got command RPT from MCS: ref #286595
2018-10-27 10:53:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:53:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286595  77 58418 39237305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:53:57 [DEBUG   ] Got command RPT from MCS: ref #286596
2018-10-27 10:53:57 [DEBUG   ] summary = ERROR
2018-10-27 10:53:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286596  13 58418 39237497 A  ERRORERROR'
2018-10-27 10:53:57 [DEBUG   ] Got command RPT from MCS: ref #286598
2018-10-27 10:53:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:53:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286598  77 58418 39237701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:53:57 [DEBUG   ] Got command RPT from MCS: ref #286599
2018-10-27 10:53:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 10:53:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286599  12 58418 39237905 A  ERRORB—™š'
2018-10-27 10:53:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:53:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:53:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:53:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:53:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:53:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:53:59 [DEBUG   ] Finished updating board flags in 1.779 seconds
2018-10-27 10:54:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 10:54:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 10:54:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 10:54:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:54:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:54:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:54:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:54:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:54:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:54:59 [DEBUG   ] Finished updating board flags in 1.626 seconds
2018-10-27 10:55:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 10:55:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 10:55:37 [DEBUG   ] Got command RPT from MCS: ref #286604
2018-10-27 10:55:37 [DEBUG   ] summary = ERROR
2018-10-27 10:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286604  13 58418 39337722 A  ERRORERROR'
2018-10-27 10:55:37 [DEBUG   ] Got command RPT from MCS: ref #286605
2018-10-27 10:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286605  77 58418 39337722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:55:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 10:55:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:55:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 10:55:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:55:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:55:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:55:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:55:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:55:59 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-10-27 10:56:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 10:56:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 10:56:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 10:56:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:56:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:56:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:56:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:56:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:56:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:56:59 [DEBUG   ] Finished updating board flags in 1.546 seconds
2018-10-27 10:57:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 10:57:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 10:57:52 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-27 10:57:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:57:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:57:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:57:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:57:59 [WARNING ] (13, 1, 'bot')
2018-10-27 10:57:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:57:59 [DEBUG   ] Finished updating board flags in 1.557 seconds
2018-10-27 10:58:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-27 10:58:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-27 10:58:53 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-27 10:58:57 [DEBUG   ] Got command RPT from MCS: ref #286625
2018-10-27 10:58:57 [DEBUG   ] summary = ERROR
2018-10-27 10:58:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286625  13 58418 39537185 A  ERRORERROR'
2018-10-27 10:58:57 [DEBUG   ] Got command RPT from MCS: ref #286626
2018-10-27 10:58:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:58:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286626  77 58418 39537389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:58:57 [DEBUG   ] Got command RPT from MCS: ref #286627
2018-10-27 10:58:57 [DEBUG   ] summary = ERROR
2018-10-27 10:58:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286627  13 58418 39537581 A  ERRORERROR'
2018-10-27 10:58:57 [DEBUG   ] Got command RPT from MCS: ref #286628
2018-10-27 10:58:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 10:58:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286628  77 58418 39537785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 10:58:57 [DEBUG   ] Got command RPT from MCS: ref #286629
2018-10-27 10:58:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 10:58:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286629  12 58418 39537989 A  ERRORB–™š'
2018-10-27 10:58:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 10:59:00 [WARNING ] (13, 1, 'bot')
2018-10-27 10:59:00 [WARNING ] (13, 1, 'bot')
2018-10-27 10:59:00 [WARNING ] (13, 1, 'bot')
2018-10-27 10:59:00 [WARNING ] (13, 1, 'bot')
2018-10-27 10:59:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 10:59:00 [DEBUG   ] Finished updating board flags in 2.202 seconds
2018-10-27 10:59:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-27 10:59:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 10:59:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 10:59:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:00:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:00:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:00:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:00:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:00:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:00:00 [DEBUG   ] Finished updating board flags in 2.094 seconds
2018-10-27 11:00:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 11:00:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 11:00:37 [DEBUG   ] Got command RPT from MCS: ref #286634
2018-10-27 11:00:37 [DEBUG   ] summary = ERROR
2018-10-27 11:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286634  13 58418 39637701 A  ERRORERROR'
2018-10-27 11:00:37 [DEBUG   ] Got command RPT from MCS: ref #286635
2018-10-27 11:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286635  77 58418 39637702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:00:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 11:00:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:01:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:01:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:01:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:01:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:01:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:01:00 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-10-27 11:01:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 11:01:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 11:01:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 11:01:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:02:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:02:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:02:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:02:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:02:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:02:00 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-10-27 11:02:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 11:02:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 11:02:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 11:02:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:03:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 11:03:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:03:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:03:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:03:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:03:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:03:00 [DEBUG   ] Finished updating board flags in 1.839 seconds
2018-10-27 11:03:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 11:03:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 11:03:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 11:03:57 [DEBUG   ] Got command RPT from MCS: ref #286657
2018-10-27 11:03:57 [DEBUG   ] summary = ERROR
2018-10-27 11:03:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286657  13 58418 39837269 A  ERRORERROR'
2018-10-27 11:03:57 [DEBUG   ] Got command RPT from MCS: ref #286658
2018-10-27 11:03:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:03:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286658  77 58418 39837461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:03:57 [DEBUG   ] Got command RPT from MCS: ref #286659
2018-10-27 11:03:57 [DEBUG   ] summary = ERROR
2018-10-27 11:03:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286659  13 58418 39837665 A  ERRORERROR'
2018-10-27 11:03:57 [DEBUG   ] Got command RPT from MCS: ref #286661
2018-10-27 11:03:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:03:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286661  77 58418 39837869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:03:58 [DEBUG   ] Got command RPT from MCS: ref #286663
2018-10-27 11:03:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 11:03:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286663  12 58418 39838073 A  ERRORB•™š'
2018-10-27 11:03:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:04:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:04:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:04:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:04:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:04:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:04:00 [DEBUG   ] Finished updating board flags in 1.765 seconds
2018-10-27 11:04:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 11:04:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 11:04:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 11:04:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:05:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:05:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:05:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:05:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:05:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:05:00 [DEBUG   ] Finished updating board flags in 1.697 seconds
2018-10-27 11:05:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 11:05:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 11:05:37 [DEBUG   ] Got command RPT from MCS: ref #286671
2018-10-27 11:05:37 [DEBUG   ] summary = ERROR
2018-10-27 11:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286671  13 58418 39937709 A  ERRORERROR'
2018-10-27 11:05:37 [DEBUG   ] Got command RPT from MCS: ref #286672
2018-10-27 11:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286672  77 58418 39937710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:05:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 11:05:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:06:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:06:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:06:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:06:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:06:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:06:00 [DEBUG   ] Finished updating board flags in 1.515 seconds
2018-10-27 11:06:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 11:06:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 11:06:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 11:06:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:07:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:07:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:07:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:07:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:07:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:07:00 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-10-27 11:07:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 11:07:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 11:07:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 11:08:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:08:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:08:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:08:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:08:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:08:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:08:00 [DEBUG   ] Finished updating board flags in 1.496 seconds
2018-10-27 11:08:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 11:08:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 11:08:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 11:08:57 [DEBUG   ] Got command RPT from MCS: ref #286692
2018-10-27 11:08:57 [DEBUG   ] summary = ERROR
2018-10-27 11:08:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286692  13 58418 40137349 A  ERRORERROR'
2018-10-27 11:08:57 [DEBUG   ] Got command RPT from MCS: ref #286693
2018-10-27 11:08:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:08:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286693  77 58418 40137557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:08:57 [DEBUG   ] Got command RPT from MCS: ref #286694
2018-10-27 11:08:57 [DEBUG   ] summary = ERROR
2018-10-27 11:08:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286694  13 58418 40137749 A  ERRORERROR'
2018-10-27 11:08:57 [DEBUG   ] Got command RPT from MCS: ref #286695
2018-10-27 11:08:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:08:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286695  77 58418 40137953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:08:58 [DEBUG   ] Got command RPT from MCS: ref #286696
2018-10-27 11:08:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 11:08:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286696  12 58418 40138157 A  ERRORB”™š'
2018-10-27 11:09:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:09:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:09:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:09:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:09:00 [WARNING ] (13, 1, 'bot')
2018-10-27 11:09:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:09:00 [DEBUG   ] Finished updating board flags in 1.528 seconds
2018-10-27 11:09:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 11:09:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 11:09:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 11:10:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:10:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:10:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:10:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:10:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:10:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:10:01 [DEBUG   ] Finished updating board flags in 2.135 seconds
2018-10-27 11:10:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-27 11:10:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 11:10:37 [DEBUG   ] Got command RPT from MCS: ref #286697
2018-10-27 11:10:37 [DEBUG   ] summary = ERROR
2018-10-27 11:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286697  13 58418 40237701 A  ERRORERROR'
2018-10-27 11:10:37 [DEBUG   ] Got command RPT from MCS: ref #286698
2018-10-27 11:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286698  77 58418 40237702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:10:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 11:11:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:11:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:11:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:11:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:11:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:11:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:11:01 [DEBUG   ] Finished updating board flags in 1.999 seconds
2018-10-27 11:11:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:11:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:11:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 11:12:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:12:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:12:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:12:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:12:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:12:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:12:01 [DEBUG   ] Finished updating board flags in 1.776 seconds
2018-10-27 11:12:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 11:12:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 11:12:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:13:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:13:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:13:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:13:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:13:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:13:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:13:01 [DEBUG   ] Finished updating board flags in 1.666 seconds
2018-10-27 11:13:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 11:13:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 11:13:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 11:13:57 [DEBUG   ] Got command RPT from MCS: ref #286720
2018-10-27 11:13:57 [DEBUG   ] summary = ERROR
2018-10-27 11:13:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286720  13 58418 40437441 A  ERRORERROR'
2018-10-27 11:13:57 [DEBUG   ] Got command RPT from MCS: ref #286721
2018-10-27 11:13:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:13:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286721  77 58418 40437633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:13:57 [DEBUG   ] Got command RPT from MCS: ref #286722
2018-10-27 11:13:57 [DEBUG   ] summary = ERROR
2018-10-27 11:13:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286722  13 58418 40437837 A  ERRORERROR'
2018-10-27 11:13:58 [DEBUG   ] Got command RPT from MCS: ref #286724
2018-10-27 11:13:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:13:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286724  77 58418 40438041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:13:58 [DEBUG   ] Got command RPT from MCS: ref #286725
2018-10-27 11:13:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 11:13:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286725  12 58418 40438245 A  ERRORB–™š'
2018-10-27 11:14:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:14:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:14:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:14:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:14:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:14:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:14:01 [DEBUG   ] Finished updating board flags in 1.534 seconds
2018-10-27 11:14:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:14:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 11:14:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 11:15:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:15:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:15:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:15:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:15:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:15:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:15:01 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-10-27 11:15:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:15:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:15:37 [DEBUG   ] Got command RPT from MCS: ref #286734
2018-10-27 11:15:37 [DEBUG   ] summary = ERROR
2018-10-27 11:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286734  13 58418 40537705 A  ERRORERROR'
2018-10-27 11:15:37 [DEBUG   ] Got command RPT from MCS: ref #286735
2018-10-27 11:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286735  77 58418 40537706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:15:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 11:16:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:16:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 11:16:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:16:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:16:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:16:01 [WARNING ] (13, 1, 'bot')
2018-10-27 11:16:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:16:01 [DEBUG   ] Finished updating board flags in 1.506 seconds
2018-10-27 11:16:13 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-10-27 11:16:34 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-27 11:16:54 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-27 11:17:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:17:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:17:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:17:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:17:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:17:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:17:02 [DEBUG   ] Finished updating board flags in 1.685 seconds
2018-10-27 11:17:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 11:17:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 11:17:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 11:18:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:18:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-27 11:18:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:18:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:18:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:18:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:18:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:18:02 [DEBUG   ] Finished updating board flags in 2.211 seconds
2018-10-27 11:18:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 11:18:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 11:18:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 11:18:57 [DEBUG   ] Got command RPT from MCS: ref #286755
2018-10-27 11:18:57 [DEBUG   ] summary = ERROR
2018-10-27 11:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286755  13 58418 40737521 A  ERRORERROR'
2018-10-27 11:18:57 [DEBUG   ] Got command RPT from MCS: ref #286756
2018-10-27 11:18:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286756  77 58418 40737725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:18:57 [DEBUG   ] Got command RPT from MCS: ref #286757
2018-10-27 11:18:57 [DEBUG   ] summary = ERROR
2018-10-27 11:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286757  13 58418 40737936 A  ERRORERROR'
2018-10-27 11:18:58 [DEBUG   ] Got command RPT from MCS: ref #286758
2018-10-27 11:18:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:18:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286758  77 58418 40738125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:18:58 [DEBUG   ] Got command RPT from MCS: ref #286759
2018-10-27 11:18:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 11:18:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286759  12 58418 40738329 A  ERRORB•™š'
2018-10-27 11:19:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:19:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:19:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:19:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:19:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:19:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:19:02 [DEBUG   ] Finished updating board flags in 2.143 seconds
2018-10-27 11:19:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-27 11:19:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 11:19:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-27 11:20:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:20:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:20:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:20:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:20:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:20:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:20:02 [DEBUG   ] Finished updating board flags in 2.024 seconds
2018-10-27 11:20:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 11:20:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 11:20:37 [DEBUG   ] Got command RPT from MCS: ref #286764
2018-10-27 11:20:37 [DEBUG   ] summary = ERROR
2018-10-27 11:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286764  13 58418 40837705 A  ERRORERROR'
2018-10-27 11:20:37 [DEBUG   ] Got command RPT from MCS: ref #286765
2018-10-27 11:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286765  77 58418 40837706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:20:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 11:21:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:21:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:21:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:21:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:21:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:21:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:21:02 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-10-27 11:21:14 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-27 11:21:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:21:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 11:22:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:22:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:22:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:22:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:22:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:22:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:22:02 [DEBUG   ] Finished updating board flags in 1.800 seconds
2018-10-27 11:22:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 11:22:34 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-27 11:22:55 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-27 11:23:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:23:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:23:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:23:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:23:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:23:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:23:02 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-10-27 11:23:15 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-27 11:23:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 11:23:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 11:23:57 [DEBUG   ] Got command RPT from MCS: ref #286787
2018-10-27 11:23:57 [DEBUG   ] summary = ERROR
2018-10-27 11:23:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286787  13 58418 41037605 A  ERRORERROR'
2018-10-27 11:23:57 [DEBUG   ] Got command RPT from MCS: ref #286788
2018-10-27 11:23:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:23:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286788  77 58418 41037809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:23:58 [DEBUG   ] Got command RPT from MCS: ref #286789
2018-10-27 11:23:58 [DEBUG   ] summary = ERROR
2018-10-27 11:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286789  13 58418 41038013 A  ERRORERROR'
2018-10-27 11:23:58 [DEBUG   ] Got command RPT from MCS: ref #286791
2018-10-27 11:23:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286791  77 58418 41038217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:23:58 [DEBUG   ] Got command RPT from MCS: ref #286793
2018-10-27 11:23:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 11:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286793  12 58418 41038409 A  ERRORB•™š'
2018-10-27 11:24:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:24:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:24:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:24:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:24:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:24:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:24:02 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-10-27 11:24:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 11:24:35 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-27 11:24:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 11:25:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:25:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:25:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:25:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:25:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:25:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:25:02 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-10-27 11:25:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 11:25:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 11:25:37 [DEBUG   ] Got command RPT from MCS: ref #286797
2018-10-27 11:25:37 [DEBUG   ] summary = ERROR
2018-10-27 11:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286797  13 58418 41137709 A  ERRORERROR'
2018-10-27 11:25:37 [DEBUG   ] Got command RPT from MCS: ref #286798
2018-10-27 11:25:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:25:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286798  77 58418 41137710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:25:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 11:26:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 11:26:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:26:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:26:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:26:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:26:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:26:02 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-10-27 11:26:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 11:26:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 11:26:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 11:27:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:27:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:27:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:27:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:27:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:27:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:27:02 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-10-27 11:27:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 11:27:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:27:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 11:28:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:28:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:28:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:28:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:28:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:28:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:28:02 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-10-27 11:28:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 11:28:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 11:28:56 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-27 11:28:57 [DEBUG   ] Got command RPT from MCS: ref #286818
2018-10-27 11:28:57 [DEBUG   ] summary = ERROR
2018-10-27 11:28:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286818  13 58418 41337689 A  ERRORERROR'
2018-10-27 11:28:57 [DEBUG   ] Got command RPT from MCS: ref #286819
2018-10-27 11:28:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:28:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286819  77 58418 41337893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:28:58 [DEBUG   ] Got command RPT from MCS: ref #286820
2018-10-27 11:28:58 [DEBUG   ] summary = ERROR
2018-10-27 11:28:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286820  13 58418 41338097 A  ERRORERROR'
2018-10-27 11:28:58 [DEBUG   ] Got command RPT from MCS: ref #286821
2018-10-27 11:28:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:28:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286821  77 58418 41338301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:28:58 [DEBUG   ] Got command RPT from MCS: ref #286822
2018-10-27 11:28:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 11:28:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286822  12 58418 41338493 A  ERRORB—™š'
2018-10-27 11:29:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:29:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:29:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:29:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:29:02 [WARNING ] (13, 1, 'bot')
2018-10-27 11:29:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:29:02 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-10-27 11:29:16 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 11:29:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 11:29:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 11:30:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:30:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:30:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:30:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:30:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:30:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:30:03 [DEBUG   ] Finished updating board flags in 1.926 seconds
2018-10-27 11:30:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 11:30:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 11:30:37 [DEBUG   ] Got command RPT from MCS: ref #286827
2018-10-27 11:30:37 [DEBUG   ] summary = ERROR
2018-10-27 11:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286827  13 58418 41437709 A  ERRORERROR'
2018-10-27 11:30:37 [DEBUG   ] Got command RPT from MCS: ref #286828
2018-10-27 11:30:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286828  77 58418 41437710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:30:56 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-27 11:31:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:31:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:31:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:31:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:31:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:31:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:31:03 [DEBUG   ] Finished updating board flags in 1.887 seconds
2018-10-27 11:31:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 11:31:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 11:31:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 11:32:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:32:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:32:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:32:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:32:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:32:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:32:03 [DEBUG   ] Finished updating board flags in 1.710 seconds
2018-10-27 11:32:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-27 11:32:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 11:32:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 11:33:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:33:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:33:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:33:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:33:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:33:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:33:03 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-27 11:33:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 11:33:36 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-27 11:33:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:33:57 [DEBUG   ] Got command RPT from MCS: ref #286850
2018-10-27 11:33:57 [DEBUG   ] summary = ERROR
2018-10-27 11:33:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286850  13 58418 41637777 A  ERRORERROR'
2018-10-27 11:33:57 [DEBUG   ] Got command RPT from MCS: ref #286851
2018-10-27 11:33:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:33:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286851  77 58418 41637981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:33:58 [DEBUG   ] Got command RPT from MCS: ref #286852
2018-10-27 11:33:58 [DEBUG   ] summary = ERROR
2018-10-27 11:33:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286852  13 58418 41638185 A  ERRORERROR'
2018-10-27 11:33:58 [DEBUG   ] Got command RPT from MCS: ref #286854
2018-10-27 11:33:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:33:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286854  77 58418 41638377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:33:58 [DEBUG   ] Got command RPT from MCS: ref #286856
2018-10-27 11:33:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 11:33:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286856  12 58418 41638581 A  ERRORB–™š'
2018-10-27 11:34:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:34:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:34:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:34:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:34:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:34:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:34:03 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-10-27 11:34:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 11:34:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 11:34:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 11:35:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:35:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:35:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:35:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:35:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:35:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:35:03 [DEBUG   ] Finished updating board flags in 1.444 seconds
2018-10-27 11:35:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:35:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:35:37 [DEBUG   ] Got command RPT from MCS: ref #286864
2018-10-27 11:35:37 [DEBUG   ] summary = ERROR
2018-10-27 11:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286864  13 58418 41737709 A  ERRORERROR'
2018-10-27 11:35:37 [DEBUG   ] Got command RPT from MCS: ref #286865
2018-10-27 11:35:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:35:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286865  77 58418 41737710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:35:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 11:36:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:36:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:36:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:36:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:36:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:36:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:36:03 [DEBUG   ] Finished updating board flags in 1.446 seconds
2018-10-27 11:36:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 11:36:37 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-27 11:36:57 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-27 11:37:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:37:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:37:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:37:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:37:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:37:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:37:03 [DEBUG   ] Finished updating board flags in 1.450 seconds
2018-10-27 11:37:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-27 11:37:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 11:37:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 11:38:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:38:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:38:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:38:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:38:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:38:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:38:03 [DEBUG   ] Finished updating board flags in 1.459 seconds
2018-10-27 11:38:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 11:38:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-27 11:38:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 11:38:57 [DEBUG   ] Got command RPT from MCS: ref #286885
2018-10-27 11:38:57 [DEBUG   ] summary = ERROR
2018-10-27 11:38:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286885  13 58418 41937869 A  ERRORERROR'
2018-10-27 11:38:58 [DEBUG   ] Got command RPT from MCS: ref #286886
2018-10-27 11:38:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:38:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286886  77 58418 41938073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:38:58 [DEBUG   ] Got command RPT from MCS: ref #286887
2018-10-27 11:38:58 [DEBUG   ] summary = ERROR
2018-10-27 11:38:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286887  13 58418 41938265 A  ERRORERROR'
2018-10-27 11:38:58 [DEBUG   ] Got command RPT from MCS: ref #286888
2018-10-27 11:38:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:38:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286888  77 58418 41938469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:38:58 [DEBUG   ] Got command RPT from MCS: ref #286889
2018-10-27 11:38:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 11:38:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286889  12 58418 41938673 A  ERRORB•™š'
2018-10-27 11:39:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:39:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:39:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:39:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:39:03 [WARNING ] (13, 1, 'bot')
2018-10-27 11:39:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:39:03 [DEBUG   ] Finished updating board flags in 1.473 seconds
2018-10-27 11:39:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-27 11:39:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 11:39:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 11:40:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:40:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:40:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:40:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:40:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:40:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:40:04 [DEBUG   ] Finished updating board flags in 2.174 seconds
2018-10-27 11:40:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 11:40:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 11:40:37 [DEBUG   ] Got command RPT from MCS: ref #286890
2018-10-27 11:40:37 [DEBUG   ] summary = ERROR
2018-10-27 11:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286890  13 58418 42037709 A  ERRORERROR'
2018-10-27 11:40:37 [DEBUG   ] Got command RPT from MCS: ref #286891
2018-10-27 11:40:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:40:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286891  77 58418 42037710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:40:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 11:41:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 11:41:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:41:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:41:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:41:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:41:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:41:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:41:04 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-10-27 11:41:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 11:41:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 11:41:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 11:42:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:42:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:42:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:42:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:42:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:42:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:42:04 [DEBUG   ] Finished updating board flags in 2.078 seconds
2018-10-27 11:42:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 11:42:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 11:42:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 11:43:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:43:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:43:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:43:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:43:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:43:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:43:04 [DEBUG   ] Finished updating board flags in 1.886 seconds
2018-10-27 11:43:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 11:43:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 11:43:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 11:43:57 [DEBUG   ] Got command RPT from MCS: ref #286913
2018-10-27 11:43:57 [DEBUG   ] summary = ERROR
2018-10-27 11:43:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286913  13 58418 42237953 A  ERRORERROR'
2018-10-27 11:43:58 [DEBUG   ] Got command RPT from MCS: ref #286914
2018-10-27 11:43:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:43:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286914  77 58418 42238157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:43:58 [DEBUG   ] Got command RPT from MCS: ref #286915
2018-10-27 11:43:58 [DEBUG   ] summary = ERROR
2018-10-27 11:43:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286915  13 58418 42238349 A  ERRORERROR'
2018-10-27 11:43:58 [DEBUG   ] Got command RPT from MCS: ref #286917
2018-10-27 11:43:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:43:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286917  77 58418 42238553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:43:58 [DEBUG   ] Got command RPT from MCS: ref #286918
2018-10-27 11:43:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 11:43:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286918  12 58418 42238757 A  ERRORB–™š'
2018-10-27 11:44:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:44:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:44:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:44:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:44:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:44:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:44:04 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-27 11:44:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:44:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:44:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 11:45:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:45:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:45:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:45:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:45:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:45:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:45:04 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-27 11:45:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 11:45:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:45:37 [DEBUG   ] Got command RPT from MCS: ref #286927
2018-10-27 11:45:37 [DEBUG   ] summary = ERROR
2018-10-27 11:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286927  13 58418 42337713 A  ERRORERROR'
2018-10-27 11:45:37 [DEBUG   ] Got command RPT from MCS: ref #286928
2018-10-27 11:45:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286928  77 58418 42337714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:45:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:46:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:46:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 11:46:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:46:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:46:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:46:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:46:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:46:04 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-10-27 11:46:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 11:46:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 11:46:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:47:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-10-27 11:47:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 11:47:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:47:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:47:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:47:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:47:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:47:04 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-10-27 11:47:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:47:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 11:47:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 11:48:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 11:48:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:48:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:48:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:48:04 [WARNING ] (13, 1, 'bot')
2018-10-27 11:48:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:48:04 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-10-27 11:48:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:48:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 11:48:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 11:48:58 [DEBUG   ] Got command RPT from MCS: ref #286948
2018-10-27 11:48:58 [DEBUG   ] summary = ERROR
2018-10-27 11:48:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286948  13 58418 42538033 A  ERRORERROR'
2018-10-27 11:48:58 [DEBUG   ] Got command RPT from MCS: ref #286949
2018-10-27 11:48:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:48:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286949  77 58418 42538237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:48:58 [DEBUG   ] Got command RPT from MCS: ref #286950
2018-10-27 11:48:58 [DEBUG   ] summary = ERROR
2018-10-27 11:48:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286950  13 58418 42538441 A  ERRORERROR'
2018-10-27 11:48:58 [DEBUG   ] Got command RPT from MCS: ref #286951
2018-10-27 11:48:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:48:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286951  77 58418 42538633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:48:58 [DEBUG   ] Got command RPT from MCS: ref #286952
2018-10-27 11:48:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 11:48:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286952  12 58418 42538837 A  ERRORB—™š'
2018-10-27 11:49:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:49:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:49:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:49:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:49:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:49:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:49:05 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-10-27 11:49:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 11:49:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 11:49:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:50:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:50:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:50:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:50:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:50:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:50:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:50:05 [DEBUG   ] Finished updating board flags in 2.184 seconds
2018-10-27 11:50:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 11:50:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 11:50:37 [DEBUG   ] Got command RPT from MCS: ref #286957
2018-10-27 11:50:37 [DEBUG   ] summary = ERROR
2018-10-27 11:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286957  13 58418 42637717 A  ERRORERROR'
2018-10-27 11:50:37 [DEBUG   ] Got command RPT from MCS: ref #286958
2018-10-27 11:50:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286958  77 58418 42637718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:50:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:51:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 11:51:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:51:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:51:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:51:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:51:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:51:05 [DEBUG   ] Finished updating board flags in 1.869 seconds
2018-10-27 11:51:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:51:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 11:51:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 11:52:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:52:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:52:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:52:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:52:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:52:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:52:05 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-27 11:52:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:52:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 11:52:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 11:53:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:53:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:53:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:53:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:53:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:53:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:53:05 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-10-27 11:53:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-27 11:53:38 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-27 11:53:58 [DEBUG   ] Got command RPT from MCS: ref #286980
2018-10-27 11:53:58 [DEBUG   ] summary = ERROR
2018-10-27 11:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286980  13 58418 42838125 A  ERRORERROR'
2018-10-27 11:53:58 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-27 11:53:58 [DEBUG   ] Got command RPT from MCS: ref #286981
2018-10-27 11:53:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286981  77 58418 42838321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:53:58 [DEBUG   ] Got command RPT from MCS: ref #286982
2018-10-27 11:53:58 [DEBUG   ] summary = ERROR
2018-10-27 11:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286982  13 58418 42838525 A  ERRORERROR'
2018-10-27 11:53:58 [DEBUG   ] Got command RPT from MCS: ref #286984
2018-10-27 11:53:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286984  77 58418 42838717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:53:58 [DEBUG   ] Got command RPT from MCS: ref #286985
2018-10-27 11:53:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 11:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286985  12 58418 42838921 A  ERRORB•™š'
2018-10-27 11:54:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:54:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:54:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:54:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:54:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:54:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:54:05 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-10-27 11:54:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-27 11:54:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-27 11:54:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 11:55:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:55:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:55:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:55:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:55:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:55:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:55:05 [DEBUG   ] Finished updating board flags in 1.585 seconds
2018-10-27 11:55:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-27 11:55:37 [DEBUG   ] Got command RPT from MCS: ref #286990
2018-10-27 11:55:37 [DEBUG   ] summary = ERROR
2018-10-27 11:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286990  13 58418 42937713 A  ERRORERROR'
2018-10-27 11:55:37 [DEBUG   ] Got command RPT from MCS: ref #286991
2018-10-27 11:55:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   286991  77 58418 42937714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:55:38 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-27 11:55:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 11:56:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:56:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:56:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:56:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:56:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:56:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:56:05 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-10-27 11:56:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 11:56:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 11:56:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-27 11:57:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:57:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:57:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:57:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:57:05 [WARNING ] (13, 1, 'bot')
2018-10-27 11:57:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:57:05 [DEBUG   ] Finished updating board flags in 1.471 seconds
2018-10-27 11:57:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 11:57:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-27 11:57:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 11:58:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:58:06 [WARNING ] (13, 1, 'bot')
2018-10-27 11:58:06 [WARNING ] (13, 1, 'bot')
2018-10-27 11:58:06 [WARNING ] (13, 1, 'bot')
2018-10-27 11:58:06 [WARNING ] (13, 1, 'bot')
2018-10-27 11:58:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:58:06 [DEBUG   ] Finished updating board flags in 2.210 seconds
2018-10-27 11:58:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-27 11:58:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 11:58:58 [DEBUG   ] Got command RPT from MCS: ref #287011
2018-10-27 11:58:58 [DEBUG   ] summary = ERROR
2018-10-27 11:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287011  13 58418 43138205 A  ERRORERROR'
2018-10-27 11:58:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 11:58:58 [DEBUG   ] Got command RPT from MCS: ref #287012
2018-10-27 11:58:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287012  77 58418 43138409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:58:58 [DEBUG   ] Got command RPT from MCS: ref #287013
2018-10-27 11:58:58 [DEBUG   ] summary = ERROR
2018-10-27 11:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287013  13 58418 43138613 A  ERRORERROR'
2018-10-27 11:58:58 [DEBUG   ] Got command RPT from MCS: ref #287014
2018-10-27 11:58:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 11:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287014  77 58418 43138805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 11:58:59 [DEBUG   ] Got command RPT from MCS: ref #287015
2018-10-27 11:58:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 11:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287015  12 58418 43139009 A  ERRORB•™š'
2018-10-27 11:59:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 11:59:06 [WARNING ] (13, 1, 'bot')
2018-10-27 11:59:06 [WARNING ] (13, 1, 'bot')
2018-10-27 11:59:06 [WARNING ] (13, 1, 'bot')
2018-10-27 11:59:06 [WARNING ] (13, 1, 'bot')
2018-10-27 11:59:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 11:59:06 [DEBUG   ] Finished updating board flags in 2.124 seconds
2018-10-27 11:59:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 11:59:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 11:59:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 12:00:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:00:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:00:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:00:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:00:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:00:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:00:06 [DEBUG   ] Finished updating board flags in 2.054 seconds
2018-10-27 12:00:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 12:00:37 [DEBUG   ] Got command RPT from MCS: ref #287020
2018-10-27 12:00:37 [DEBUG   ] summary = ERROR
2018-10-27 12:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287020  13 58418 43237721 A  ERRORERROR'
2018-10-27 12:00:37 [DEBUG   ] Got command RPT from MCS: ref #287021
2018-10-27 12:00:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 12:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287021  77 58418 43237722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 12:00:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-27 12:00:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 12:01:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:01:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:01:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:01:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:01:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:01:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:01:06 [DEBUG   ] Finished updating board flags in 1.946 seconds
2018-10-27 12:01:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 12:01:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 12:01:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-27 12:02:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 12:02:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:02:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:02:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:02:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:02:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:02:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:02:06 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-10-27 12:02:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 12:02:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 12:02:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 12:03:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:03:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 12:03:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:03:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:03:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:03:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:03:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:03:06 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-10-27 12:03:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-27 12:03:39 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-10-27 12:03:58 [DEBUG   ] Got command RPT from MCS: ref #287043
2018-10-27 12:03:58 [DEBUG   ] summary = ERROR
2018-10-27 12:03:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287043  13 58418 43438289 A  ERRORERROR'
2018-10-27 12:03:58 [DEBUG   ] Got command RPT from MCS: ref #287044
2018-10-27 12:03:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 12:03:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287044  77 58418 43438493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 12:03:58 [DEBUG   ] Got command RPT from MCS: ref #287045
2018-10-27 12:03:58 [DEBUG   ] summary = ERROR
2018-10-27 12:03:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287045  13 58418 43438697 A  ERRORERROR'
2018-10-27 12:03:58 [DEBUG   ] Got command RPT from MCS: ref #287047
2018-10-27 12:03:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 12:03:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287047  77 58418 43438889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 12:03:59 [DEBUG   ] Got command RPT from MCS: ref #287048
2018-10-27 12:03:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 12:03:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287048  12 58418 43439093 A  ERRORB—™š'
2018-10-27 12:03:59 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-27 12:04:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:04:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:04:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:04:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:04:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:04:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:04:06 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-27 12:04:19 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-27 12:04:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 12:04:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-27 12:05:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-27 12:05:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:05:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 12:05:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:05:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:05:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:05:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:05:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:05:06 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-10-27 12:05:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-27 12:05:37 [DEBUG   ] Got command RPT from MCS: ref #287057
2018-10-27 12:05:37 [DEBUG   ] summary = ERROR
2018-10-27 12:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287057  13 58418 43537726 A  ERRORERROR'
2018-10-27 12:05:37 [DEBUG   ] Got command RPT from MCS: ref #287058
2018-10-27 12:05:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 12:05:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287058  77 58418 43537726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 12:05:39 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-10-27 12:05:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 12:06:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:06:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:06:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:06:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:06:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:06:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:06:06 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-10-27 12:06:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 12:06:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 12:06:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 12:07:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:07:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:07:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:07:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:07:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:07:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:07:06 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-10-27 12:07:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 12:07:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 12:07:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 12:08:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:08:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:08:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:08:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:08:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:08:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:08:06 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-10-27 12:08:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 12:08:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 12:08:58 [DEBUG   ] Got command RPT from MCS: ref #287078
2018-10-27 12:08:58 [DEBUG   ] summary = ERROR
2018-10-27 12:08:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287078  13 58418 43738373 A  ERRORERROR'
2018-10-27 12:08:58 [DEBUG   ] Got command RPT from MCS: ref #287079
2018-10-27 12:08:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 12:08:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287079  77 58418 43738578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 12:08:58 [DEBUG   ] Got command RPT from MCS: ref #287080
2018-10-27 12:08:58 [DEBUG   ] summary = ERROR
2018-10-27 12:08:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287080  13 58418 43738769 A  ERRORERROR'
2018-10-27 12:08:58 [DEBUG   ] Got command RPT from MCS: ref #287081
2018-10-27 12:08:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 12:08:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287081  77 58418 43738973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 12:08:59 [DEBUG   ] Got command RPT from MCS: ref #287082
2018-10-27 12:08:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 12:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287082  12 58418 43739177 A  ERRORB–™š'
2018-10-27 12:08:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 12:09:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:09:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:09:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:09:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:09:06 [WARNING ] (13, 1, 'bot')
2018-10-27 12:09:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:09:06 [DEBUG   ] Finished updating board flags in 1.558 seconds
2018-10-27 12:09:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 12:09:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 12:09:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 12:10:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:10:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:10:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:10:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:10:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:10:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:10:07 [DEBUG   ] Finished updating board flags in 2.284 seconds
2018-10-27 12:10:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 12:10:37 [DEBUG   ] Got command RPT from MCS: ref #287083
2018-10-27 12:10:37 [DEBUG   ] summary = ERROR
2018-10-27 12:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287083  13 58418 43837721 A  ERRORERROR'
2018-10-27 12:10:37 [DEBUG   ] Got command RPT from MCS: ref #287084
2018-10-27 12:10:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 12:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287084  77 58418 43837722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 12:10:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 12:10:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 12:11:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:11:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:11:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:11:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:11:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:11:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:11:07 [DEBUG   ] Finished updating board flags in 2.093 seconds
2018-10-27 12:11:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 12:11:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 12:11:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 12:12:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:12:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:12:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:12:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:12:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:12:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:12:07 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-10-27 12:12:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 12:12:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 12:12:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 12:13:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:13:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:13:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:13:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:13:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:13:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:13:07 [DEBUG   ] Finished updating board flags in 2.020 seconds
2018-10-27 12:13:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 12:13:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 12:13:58 [DEBUG   ] Got command RPT from MCS: ref #287106
2018-10-27 12:13:58 [DEBUG   ] summary = ERROR
2018-10-27 12:13:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287106  13 58418 44038465 A  ERRORERROR'
2018-10-27 12:13:58 [DEBUG   ] Got command RPT from MCS: ref #287107
2018-10-27 12:13:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 12:13:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287107  77 58418 44038657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 12:13:58 [DEBUG   ] Got command RPT from MCS: ref #287108
2018-10-27 12:13:58 [DEBUG   ] summary = ERROR
2018-10-27 12:13:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287108  13 58418 44038861 A  ERRORERROR'
2018-10-27 12:13:59 [DEBUG   ] Got command RPT from MCS: ref #287110
2018-10-27 12:13:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 12:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287110  77 58418 44039065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 12:13:59 [DEBUG   ] Got command RPT from MCS: ref #287111
2018-10-27 12:13:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 12:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287111  12 58418 44039257 A  ERRORB•™š'
2018-10-27 12:13:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 12:14:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:14:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:14:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:14:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:14:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:14:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:14:07 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-10-27 12:14:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 12:14:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 12:14:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 12:15:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:15:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:15:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:15:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:15:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:15:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:15:07 [DEBUG   ] Finished updating board flags in 1.876 seconds
2018-10-27 12:15:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 12:15:37 [DEBUG   ] Got command RPT from MCS: ref #287120
2018-10-27 12:15:37 [DEBUG   ] summary = ERROR
2018-10-27 12:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287120  13 58418 44137725 A  ERRORERROR'
2018-10-27 12:15:37 [DEBUG   ] Got command RPT from MCS: ref #287121
2018-10-27 12:15:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 12:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287121  77 58418 44137726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 12:15:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 12:15:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 12:16:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:16:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:16:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:16:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:16:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:16:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:16:07 [DEBUG   ] Finished updating board flags in 1.843 seconds
2018-10-27 12:16:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 12:16:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 12:16:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 12:17:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:17:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:17:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:17:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:17:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:17:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:17:07 [DEBUG   ] Finished updating board flags in 1.660 seconds
2018-10-27 12:17:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 12:17:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 12:17:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 12:18:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 12:18:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:18:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:18:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:18:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:18:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:18:07 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-10-27 12:18:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 12:18:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 12:18:58 [DEBUG   ] Got command RPT from MCS: ref #287141
2018-10-27 12:18:58 [DEBUG   ] summary = ERROR
2018-10-27 12:18:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287141  13 58418 44338550 A  ERRORERROR'
2018-10-27 12:18:58 [DEBUG   ] Got command RPT from MCS: ref #287142
2018-10-27 12:18:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 12:18:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287142  77 58418 44338741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 12:18:58 [DEBUG   ] Got command RPT from MCS: ref #287143
2018-10-27 12:18:58 [DEBUG   ] summary = ERROR
2018-10-27 12:18:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287143  13 58418 44338945 A  ERRORERROR'
2018-10-27 12:18:59 [DEBUG   ] Got command RPT from MCS: ref #287144
2018-10-27 12:18:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 12:18:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287144  77 58418 44339149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 12:18:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 12:18:59 [DEBUG   ] Got command RPT from MCS: ref #287145
2018-10-27 12:18:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 12:18:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287145  12 58418 44339353 A  ERRORB–™š'
2018-10-27 12:19:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:19:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:19:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:19:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:19:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:19:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:19:07 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-10-27 12:19:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-27 12:19:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-27 12:19:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-27 12:20:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:20:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:20:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:20:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:20:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:20:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:20:07 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-27 12:20:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 12:20:37 [DEBUG   ] Got command RPT from MCS: ref #287150
2018-10-27 12:20:37 [DEBUG   ] summary = ERROR
2018-10-27 12:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287150  13 58418 44437725 A  ERRORERROR'
2018-10-27 12:20:37 [DEBUG   ] Got command RPT from MCS: ref #287151
2018-10-27 12:20:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 12:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287151  77 58418 44437726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 12:20:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 12:20:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-27 12:21:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:21:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:21:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:21:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:21:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:21:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:21:07 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-10-27 12:21:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-27 12:21:39 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-27 12:21:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 12:22:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:22:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:22:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:22:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:22:07 [WARNING ] (13, 1, 'bot')
2018-10-27 12:22:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:22:07 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-10-27 12:22:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 12:22:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 12:22:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 12:23:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:23:08 [WARNING ] (13, 1, 'bot')
2018-10-27 12:23:08 [WARNING ] (13, 1, 'bot')
2018-10-27 12:23:08 [WARNING ] (13, 1, 'bot')
2018-10-27 12:23:08 [WARNING ] (13, 1, 'bot')
2018-10-27 12:23:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:23:08 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-10-27 12:23:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 12:23:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 12:23:58 [DEBUG   ] Got command RPT from MCS: ref #287173
2018-10-27 12:23:58 [DEBUG   ] summary = ERROR
2018-10-27 12:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287173  13 58418 44638629 A  ERRORERROR'
2018-10-27 12:23:58 [DEBUG   ] Got command RPT from MCS: ref #287174
2018-10-27 12:23:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 12:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287174  77 58418 44638833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 12:23:59 [DEBUG   ] Got command RPT from MCS: ref #287175
2018-10-27 12:23:59 [DEBUG   ] summary = ERROR
2018-10-27 12:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287175  13 58418 44639037 A  ERRORERROR'
2018-10-27 12:23:59 [DEBUG   ] Got command RPT from MCS: ref #287177
2018-10-27 12:23:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-27 12:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287177  77 58418 44639229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-27 12:23:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-27 12:23:59 [DEBUG   ] Got command RPT from MCS: ref #287178
2018-10-27 12:23:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-27 12:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   287178  12 58418 44639433 A  ERRORB—™š'
2018-10-27 12:24:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-27 12:24:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-27 12:24:08 [WARNING ] (13, 1, 'bot')
2018-10-27 12:24:08 [WARNING ] (13, 1, 'bot')
2018-10-27 12:24:08 [WARNING ] (13, 1, 'bot')
2018-10-27 12:24:08 [WARNING ] (13, 1, 'bot')
2018-10-27 12:24:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-27 12:24:08 [DEBUG   ] Finished updating board flags in 2.165 seconds
2018-10-27 12:24:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-27 12:24:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-27 12:24:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
